Nov 14 17:45:02 user nova-compute[76161]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=76161) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 17:45:02 user nova-compute[76161]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=76161) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 17:45:02 user nova-compute[76161]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=76161) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 17:45:02 user nova-compute[76161]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:45:03 user nova-compute[76161]: INFO nova.virt.driver [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 17:45:03 user nova-compute[76161]: INFO nova.compute.provider_config [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] Acquiring lock "singleton_lock" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] Acquired lock "singleton_lock" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] Releasing lock "singleton_lock" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] Full set of CONF: {{(pid=76161) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ******************************************************************************** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] Configuration options gathered from: {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ================================================================================ {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] allow_resize_to_same_host      = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] arq_binding_timeout            = 300 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] backdoor_port                  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] backdoor_socket                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] block_device_allocate_retries  = 300 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] block_device_allocate_retries_interval = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cert                           = self.pem {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute_monitors               = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] config_dir                     = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] config_drive_format            = iso9660 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] config_source                  = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] console_host                   = user {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] control_exchange               = nova {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cpu_allocation_ratio           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] daemon                         = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] debug                          = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] default_access_ip_network_name = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] default_availability_zone      = nova {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] default_ephemeral_format       = ext4 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] default_green_pool_size        = 1000 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] default_schedule_zone          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] disk_allocation_ratio          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] enable_new_services            = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] enabled_apis                   = ['osapi_compute'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] enabled_ssl_apis               = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] flat_injected                  = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] force_config_drive             = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] force_raw_images               = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] graceful_shutdown_timeout      = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] heal_instance_info_cache_interval = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] host                           = user {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] instance_build_timeout         = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] instance_delete_interval       = 300 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] instance_name_template         = instance-%08x {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] instance_usage_audit           = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] instance_usage_audit_period    = month {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] internal_service_availability_zone = internal {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] key                            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] live_migration_retry_count     = 30 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] log_config_append              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] log_dir                        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] log_file                       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] log_options                    = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] log_rotate_interval            = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] log_rotate_interval_type       = days {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] log_rotation_type              = none {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] long_rpc_timeout               = 1800 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] max_concurrent_builds          = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] max_concurrent_live_migrations = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] max_concurrent_snapshots       = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] max_local_block_devices        = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] max_logfile_count              = 30 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] max_logfile_size_mb            = 200 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] maximum_instance_delete_attempts = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] metadata_listen                = 0.0.0.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] metadata_listen_port           = 8775 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] metadata_workers               = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] migrate_max_retries            = -1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] mkisofs_cmd                    = genisoimage {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] my_ip                          = 10.0.0.210 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] network_allocate_retries       = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] osapi_compute_listen_port      = 8774 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] osapi_compute_unique_server_name_scope =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] osapi_compute_workers          = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] password_length                = 12 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] periodic_enable                = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] periodic_fuzzy_delay           = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] pointer_model                  = ps2mouse {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] preallocate_images             = none {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] publish_errors                 = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] pybasedir                      = /opt/stack/nova {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ram_allocation_ratio           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] rate_limit_burst               = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] rate_limit_except_level        = CRITICAL {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] rate_limit_interval            = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] reboot_timeout                 = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] reclaim_instance_interval      = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] record                         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] reimage_timeout_per_gb         = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] report_interval                = 120 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] rescue_timeout                 = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] reserved_host_cpus             = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] reserved_host_disk_mb          = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] reserved_host_memory_mb        = 512 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] reserved_huge_pages            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] resize_confirm_window          = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] resize_fs_using_block_device   = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] resume_guests_state_on_host_boot = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] rpc_response_timeout           = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] run_external_periodic_tasks    = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] running_deleted_instance_action = reap {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] running_deleted_instance_poll_interval = 1800 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] running_deleted_instance_timeout = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler_instance_sync_interval = 120 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_down_time              = 720 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] servicegroup_driver            = db {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] shelved_offload_time           = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] shelved_poll_interval          = 3600 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] shutdown_timeout               = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] source_is_ipv6                 = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ssl_only                       = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] state_path                     = /opt/stack/data/nova {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] sync_power_state_interval      = 600 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] sync_power_state_pool_size     = 1000 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] syslog_log_facility            = LOG_USER {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] tempdir                        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] timeout_nbd                    = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] transport_url                  = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] update_resources_interval      = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] use_cow_images                 = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] use_eventlog                   = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] use_journal                    = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] use_json                       = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] use_rootwrap_daemon            = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] use_stderr                     = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] use_syslog                     = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vcpu_pin_set                   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plugging_is_fatal          = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plugging_timeout           = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] virt_mkfs                      = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] volume_usage_poll_interval     = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] watch_log_file                 = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] web                            = /usr/share/spice-html5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_concurrency.disable_process_locking = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.auth_strategy              = keystone {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.compute_link_prefix        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.dhcp_domain                = novalocal {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.enable_instance_password   = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.glance_link_prefix         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.instance_list_per_project_cells = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.list_records_by_skipping_down_cells = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.local_metadata_per_cell    = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.max_limit                  = 1000 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.metadata_cache_expiration  = 15 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.neutron_default_tenant_id  = default {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.use_forwarded_for          = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.use_neutron_default_nets   = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.vendordata_dynamic_targets = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.vendordata_jsonfile_path   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.backend                  = dogpile.cache.memcached {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.backend_argument         = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.config_prefix            = cache.oslo {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.dead_timeout             = 60.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.debug_cache_backend      = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.enable_retry_client      = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.enable_socket_keepalive  = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.enabled                  = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.expiration_time          = 600 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.hashclient_retry_attempts = 2 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.memcache_dead_retry      = 300 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.memcache_password        =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.memcache_sasl_enabled    = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.memcache_username        =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.proxies                  = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.retry_attempts           = 2 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.retry_delay              = 0.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.socket_keepalive_count   = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.socket_keepalive_idle    = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.socket_keepalive_interval = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.tls_allowed_ciphers      = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.tls_cafile               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.tls_certfile             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.tls_enabled              = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cache.tls_keyfile              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.auth_section            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.auth_type               = password {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.cafile                  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.certfile                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.collect_timing          = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.cross_az_attach         = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.debug                   = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.endpoint_template       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.http_retries            = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.insecure                = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.keyfile                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.os_region_name          = RegionOne {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.split_loggers           = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cinder.timeout                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.cpu_dedicated_set      = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.cpu_shared_set         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.image_type_exclude_list = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.max_concurrent_disk_ops = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.max_disk_devices_to_attach = -1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.resource_provider_association_refresh = 300 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.shutdown_retry_interval = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] conductor.workers              = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] console.allowed_origins        = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] console.ssl_ciphers            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] console.ssl_minimum_version    = default {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] consoleauth.token_ttl          = 600 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.cafile                  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.certfile                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.collect_timing          = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.connect_retries         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.connect_retry_delay     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.endpoint_override       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.insecure                = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.keyfile                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.max_version             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.min_version             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.region_name             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.service_name            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.service_type            = accelerator {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.split_loggers           = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.status_code_retries     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.status_code_retry_delay = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.timeout                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] cyborg.version                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.backend               = sqlalchemy {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.connection            = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.connection_debug      = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.connection_parameters =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.connection_recycle_time = 3600 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.connection_trace      = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.db_inc_retry_interval = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.db_max_retries        = 20 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.db_max_retry_interval = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.db_retry_interval     = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.max_overflow          = 50 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.max_pool_size         = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.max_retries           = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.mysql_wsrep_sync_wait = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.pool_timeout          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.retry_interval        = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.slave_connection      = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] database.sqlite_synchronous    = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.backend           = sqlalchemy {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.connection        = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.connection_debug  = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.connection_parameters =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.connection_recycle_time = 3600 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.connection_trace  = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.db_inc_retry_interval = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.db_max_retries    = 20 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.db_max_retry_interval = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.db_retry_interval = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.max_overflow      = 50 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.max_pool_size     = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.max_retries       = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.pool_timeout      = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.retry_interval    = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.slave_connection  = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] api_database.sqlite_synchronous = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] devices.enabled_mdev_types     = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ephemeral_storage_encryption.enabled = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.api_servers             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.cafile                  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.certfile                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.collect_timing          = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.connect_retries         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.connect_retry_delay     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.debug                   = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.default_trusted_certificate_ids = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.enable_certificate_validation = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.enable_rbd_download     = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.endpoint_override       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.insecure                = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.keyfile                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.max_version             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.min_version             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.num_retries             = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.rbd_ceph_conf           =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.rbd_connect_timeout     = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.rbd_pool                =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.rbd_user                =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.region_name             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.service_name            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.service_type            = image {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.split_loggers           = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.status_code_retries     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.status_code_retry_delay = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.timeout                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.verify_glance_signatures = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] glance.version                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] guestfs.debug                  = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.config_drive_cdrom      = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.config_drive_inject_password = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.enable_instance_metrics_collection = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.enable_remotefx         = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.instances_path_share    =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.iscsi_initiator_list    = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.limit_cpu_features      = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.power_state_check_timeframe = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.use_multipath_io        = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.volume_attach_retry_count = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.vswitch_name            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] mks.enabled                    = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] image_cache.manager_interval   = 2400 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] image_cache.precache_concurrency = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] image_cache.remove_unused_base_images = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] image_cache.subdirectory_name  = _base {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.api_max_retries         = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.api_retry_interval      = 2 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.auth_section            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.auth_type               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.cafile                  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.certfile                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.collect_timing          = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.conductor_group         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.connect_retries         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.connect_retry_delay     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.endpoint_override       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.insecure                = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.keyfile                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.max_version             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.min_version             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.peer_list               = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.region_name             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.serial_console_state_timeout = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.service_name            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.service_type            = baremetal {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.split_loggers           = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.status_code_retries     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.status_code_retry_delay = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.timeout                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ironic.version                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] key_manager.fixed_key          = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.barbican_api_version  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.barbican_endpoint     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.barbican_endpoint_type = public {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.barbican_region_name  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.cafile                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.certfile              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.collect_timing        = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.insecure              = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.keyfile               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.number_of_retries     = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.retry_delay           = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.send_service_user_token = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.split_loggers         = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.timeout               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.verify_ssl            = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican.verify_ssl_path       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican_service_user.auth_section = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican_service_user.auth_type = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican_service_user.cafile   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican_service_user.certfile = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican_service_user.collect_timing = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican_service_user.insecure = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican_service_user.keyfile  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican_service_user.split_loggers = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] barbican_service_user.timeout  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.approle_role_id          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.approle_secret_id        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.cafile                   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.certfile                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.collect_timing           = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.insecure                 = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.keyfile                  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.kv_mountpoint            = secret {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.kv_path                  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.kv_version               = 2 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.namespace                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.root_token_id            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.split_loggers            = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.ssl_ca_crt_file          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.timeout                  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.use_ssl                  = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.auth_section          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.auth_type             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.cafile                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.certfile              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.collect_timing        = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.connect_retries       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.connect_retry_delay   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.endpoint_override     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.insecure              = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.keyfile               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.max_version           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.min_version           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.region_name           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.service_name          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.service_type          = identity {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.split_loggers         = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.status_code_retries   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.status_code_retry_delay = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.timeout               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] keystone.version               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.connection_uri         =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.cpu_mode               = custom {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: WARNING oslo_config.cfg [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.cpu_power_governor_high = performance {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.cpu_power_governor_low = powersave {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.cpu_power_management   = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.device_detach_attempts = 8 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.device_detach_timeout  = 20 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.disk_cachemodes        = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.disk_prefix            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.enabled_perf_events    = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.file_backed_memory     = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.gid_maps               = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.hw_disk_discard        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.hw_machine_type        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.images_rbd_glance_store_name =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.images_rbd_pool        = rbd {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.images_type            = default {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.images_volume_group    = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.inject_key             = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.inject_partition       = -2 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.inject_password        = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.iscsi_iface            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.iser_use_multipath     = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_bandwidth = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_downtime = 500 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_inbound_addr = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_permit_post_copy = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_scheme  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_timeout_action = abort {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_tunnelled = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: WARNING oslo_config.cfg [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 17:45:03 user nova-compute[76161]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 17:45:03 user nova-compute[76161]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 17:45:03 user nova-compute[76161]: and ``live_migration_inbound_addr`` respectively.
Nov 14 17:45:03 user nova-compute[76161]: ).  Its value may be silently ignored in the future.
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.live_migration_with_native_tls = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.max_queues             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.nfs_mount_options      = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.num_memory_encrypted_guests = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.num_pcie_ports         = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.pmem_namespaces        = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.quobyte_client_cfg     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.rbd_secret_uuid        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.rbd_user               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.remote_filesystem_transport = ssh {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.rescue_image_id        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.rescue_kernel_id       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.rescue_ramdisk_id      = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.rx_queue_size          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.smbfs_mount_options    =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.snapshot_compression   = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.snapshot_image_format  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.sparse_logical_volumes = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.swtpm_enabled          = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.swtpm_group            = tss {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.swtpm_user             = tss {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.sysinfo_serial         = unique {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.tb_cache_size          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.tx_queue_size          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.uid_maps               = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.use_virtio_for_bridges = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.virt_type              = kvm {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.volume_clear           = zero {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.volume_clear_size      = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.volume_use_multipath   = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.vzstorage_cache_path   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.vzstorage_mount_user   = stack {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.auth_section           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.auth_type              = password {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.cafile                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.certfile               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.collect_timing         = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.connect_retries        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.connect_retry_delay    = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.default_floating_pool  = public {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.endpoint_override      = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.extension_sync_interval = 600 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.http_retries           = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.insecure               = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.keyfile                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.max_version            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.min_version            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.ovs_bridge             = br-int {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.physnets               = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.region_name            = RegionOne {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.service_metadata_proxy = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.service_name           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.service_type           = network {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.split_loggers          = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.status_code_retries    = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.status_code_retry_delay = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.timeout                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] neutron.version                = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] notifications.bdms_in_notifications = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] notifications.default_level    = INFO {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] notifications.notification_format = unversioned {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] notifications.notify_on_state_change = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] pci.alias                      = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] pci.device_spec                = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] pci.report_in_placement        = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.auth_section         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.auth_type            = password {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.cafile               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.certfile             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.collect_timing       = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.connect_retries      = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.connect_retry_delay  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.default_domain_id    = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.default_domain_name  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.domain_id            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.domain_name          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.endpoint_override    = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.insecure             = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.keyfile              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.max_version          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.min_version          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.password             = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.project_domain_id    = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.project_domain_name  = Default {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.project_id           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.project_name         = service {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.region_name          = RegionOne {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.service_name         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.service_type         = placement {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.split_loggers        = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.status_code_retries  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.status_code_retry_delay = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.system_scope         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.timeout              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.trust_id             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.user_domain_id       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.user_domain_name     = Default {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.user_id              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.username             = placement {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] placement.version              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.cores                    = 20 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.count_usage_from_placement = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.injected_file_content_bytes = 10240 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.injected_file_path_length = 255 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.injected_files           = 5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.instances                = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.key_pairs                = 100 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.metadata_items           = 128 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.ram                      = 51200 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.recheck_quota            = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.server_group_members     = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] quota.server_groups            = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] rdp.enabled                    = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler.image_metadata_prefilter = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler.max_attempts         = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler.max_placement_results = 1000 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler.query_placement_for_image_type_support = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] scheduler.workers              = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.host_subset_size = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.isolated_hosts = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.isolated_images = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.pci_in_placement = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.track_instance_changes = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] metrics.required               = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] metrics.weight_multiplier      = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] metrics.weight_setting         = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] serial_console.enabled         = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] serial_console.port_range      = 10000:20000 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] serial_console.serialproxy_port = 6083 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_user.auth_section      = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_user.auth_type         = password {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_user.cafile            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_user.certfile          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_user.collect_timing    = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_user.insecure          = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_user.keyfile           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_user.send_service_user_token = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_user.split_loggers     = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] service_user.timeout           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.agent_enabled            = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.enabled                  = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.html5proxy_port          = 6082 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.image_compression        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.jpeg_compression         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.playback_compression     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.server_listen            = 127.0.0.1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.streaming_mode           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] spice.zlib_compression         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] upgrade_levels.baseapi         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] upgrade_levels.cert            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] upgrade_levels.compute         = auto {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] upgrade_levels.conductor       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] upgrade_levels.scheduler       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vendordata_dynamic_auth.auth_section = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vendordata_dynamic_auth.auth_type = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vendordata_dynamic_auth.cafile = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vendordata_dynamic_auth.certfile = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vendordata_dynamic_auth.insecure = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vendordata_dynamic_auth.keyfile = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vendordata_dynamic_auth.timeout = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.api_retry_count         = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.ca_file                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.cache_prefix            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.cluster_name            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.connection_pool_size    = 10 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.console_delay_seconds   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.datastore_regex         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.host_ip                 = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.host_password           = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.host_port               = 443 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.host_username           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.insecure                = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.integration_bridge      = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.maximum_objects         = 100 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.pbm_default_policy      = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.pbm_enabled             = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.pbm_wsdl_location       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.serial_port_proxy_uri   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.serial_port_service_uri = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.task_poll_interval      = 0.5 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.use_linked_clone        = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.vnc_keymap              = en-us {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.vnc_port                = 5900 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vmware.vnc_port_total          = 10000 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vnc.auth_schemes               = ['none'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vnc.enabled                    = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vnc.novncproxy_port            = 6080 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vnc.server_listen              = 0.0.0.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vnc.vencrypt_ca_certs          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vnc.vencrypt_client_cert       = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vnc.vencrypt_client_key        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.disable_rootwrap   = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.enable_numa_live_migration = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.libvirt_disable_apic = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.client_socket_timeout     = 900 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.default_pool_size         = 1000 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.keep_alive                = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.max_header_line           = 16384 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.ssl_ca_file               = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.ssl_cert_file             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.ssl_key_file              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.tcp_keepidle              = 600 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] zvm.ca_file                    = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] zvm.cloud_connector_url        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] zvm.reachable_timeout          = 300 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_policy.enforce_new_defaults = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_policy.enforce_scope      = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_policy.policy_default_rule = default {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.connection_string     = messaging:// {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.enabled               = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.es_doc_type           = notification {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.es_scroll_size        = 10000 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.es_scroll_time        = 2m {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.filter_error_trace    = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.hmac_keys             = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.sentinel_service_name = mymaster {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.socket_timeout        = 0.1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.trace_requests        = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler.trace_sqlalchemy      = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler_jaeger.process_tags   = {} {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler_jaeger.service_name_prefix = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] profiler_otlp.service_name_prefix = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] remote_debug.host              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] remote_debug.port              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_notifications.retry = -1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.auth_section        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.auth_type           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.cafile              = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.certfile            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.collect_timing      = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.connect_retries     = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.connect_retry_delay = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.endpoint_id         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.endpoint_override   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.insecure            = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.keyfile             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.max_version         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.min_version         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.region_name         = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.service_name        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.service_type        = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.split_loggers       = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.status_code_retries = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.status_code_retry_delay = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.timeout             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.valid_interfaces    = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_limit.version             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_reports.file_event_handler = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] oslo_reports.log_dir           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_ovs_privileged.group  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] vif_plug_ovs_privileged.user   = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_linux_bridge.flat_interface = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_ovs.isolate_vif         = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_vif_ovs.per_port_bridge     = False {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] os_brick.lock_path             = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] privsep_osbrick.capabilities   = [21] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] privsep_osbrick.group          = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] privsep_osbrick.helper_command = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] privsep_osbrick.user           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] nova_sys_admin.group           = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] nova_sys_admin.helper_command  = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] nova_sys_admin.user            = None {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG oslo_service.service [None req-f84a5e7d-3208-4353-889e-484cb8ed7e30 None None] ******************************************************************************** {{(pid=76161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 17:45:03 user nova-compute[76161]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 17:45:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Connecting to libvirt: qemu:///system {{(pid=76161) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb4f8e93070> {{(pid=76161) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 17:45:03 user nova-compute[76161]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 17:45:03 user nova-compute[76161]: WARNING nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 17:45:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb4f8e93070> {{(pid=76161) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Starting native event thread {{(pid=76161) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Starting green dispatch thread {{(pid=76161) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 17:45:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Starting connection event dispatch thread {{(pid=76161) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 17:45:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Connection event '1' reason 'None'
Nov 14 17:45:03 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 17:45:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.mount [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Initialising _HostMountState generation 0 {{(pid=76161) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 17:45:10 user nova-compute[76161]: INFO nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Libvirt host capabilities <capabilities>
Nov 14 17:45:10 user nova-compute[76161]:   <host>
Nov 14 17:45:10 user nova-compute[76161]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 17:45:10 user nova-compute[76161]:     <cpu>
Nov 14 17:45:10 user nova-compute[76161]:       <arch>x86_64</arch>
Nov 14 17:45:10 user nova-compute[76161]:       <model>IvyBridge-IBRS</model>
Nov 14 17:45:10 user nova-compute[76161]:       <vendor>Intel</vendor>
Nov 14 17:45:10 user nova-compute[76161]:       <microcode version='1070'/>
Nov 14 17:45:10 user nova-compute[76161]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 17:45:10 user nova-compute[76161]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='ss'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='vmx'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='pcid'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='osxsave'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='hypervisor'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='arat'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='tsc_adjust'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='md-clear'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='stibp'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='arch-capabilities'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='ssbd'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='invtsc'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='rsba'/>
Nov 14 17:45:10 user nova-compute[76161]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 17:45:10 user nova-compute[76161]:       <pages unit='KiB' size='4'/>
Nov 14 17:45:10 user nova-compute[76161]:       <pages unit='KiB' size='2048'/>
Nov 14 17:45:10 user nova-compute[76161]:     </cpu>
Nov 14 17:45:10 user nova-compute[76161]:     <power_management>
Nov 14 17:45:10 user nova-compute[76161]:       <suspend_mem/>
Nov 14 17:45:10 user nova-compute[76161]:       <suspend_disk/>
Nov 14 17:45:10 user nova-compute[76161]:       <suspend_hybrid/>
Nov 14 17:45:10 user nova-compute[76161]:     </power_management>
Nov 14 17:45:10 user nova-compute[76161]:     <iommu support='no'/>
Nov 14 17:45:10 user nova-compute[76161]:     <migration_features>
Nov 14 17:45:10 user nova-compute[76161]:       <live/>
Nov 14 17:45:10 user nova-compute[76161]:       <uri_transports>
Nov 14 17:45:10 user nova-compute[76161]:         <uri_transport>tcp</uri_transport>
Nov 14 17:45:10 user nova-compute[76161]:         <uri_transport>rdma</uri_transport>
Nov 14 17:45:10 user nova-compute[76161]:       </uri_transports>
Nov 14 17:45:10 user nova-compute[76161]:     </migration_features>
Nov 14 17:45:10 user nova-compute[76161]:     <topology>
Nov 14 17:45:10 user nova-compute[76161]:       <cells num='2'>
Nov 14 17:45:10 user nova-compute[76161]:         <cell id='0'>
Nov 14 17:45:10 user nova-compute[76161]:           <memory unit='KiB'>8140616</memory>
Nov 14 17:45:10 user nova-compute[76161]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 14 17:45:10 user nova-compute[76161]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 17:45:10 user nova-compute[76161]:           <distances>
Nov 14 17:45:10 user nova-compute[76161]:             <sibling id='0' value='10'/>
Nov 14 17:45:10 user nova-compute[76161]:             <sibling id='1' value='20'/>
Nov 14 17:45:10 user nova-compute[76161]:           </distances>
Nov 14 17:45:10 user nova-compute[76161]:           <cpus num='6'>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 17:45:10 user nova-compute[76161]:           </cpus>
Nov 14 17:45:10 user nova-compute[76161]:         </cell>
Nov 14 17:45:10 user nova-compute[76161]:         <cell id='1'>
Nov 14 17:45:10 user nova-compute[76161]:           <memory unit='KiB'>8255068</memory>
Nov 14 17:45:10 user nova-compute[76161]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 14 17:45:10 user nova-compute[76161]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 17:45:10 user nova-compute[76161]:           <distances>
Nov 14 17:45:10 user nova-compute[76161]:             <sibling id='0' value='20'/>
Nov 14 17:45:10 user nova-compute[76161]:             <sibling id='1' value='10'/>
Nov 14 17:45:10 user nova-compute[76161]:           </distances>
Nov 14 17:45:10 user nova-compute[76161]:           <cpus num='6'>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 17:45:10 user nova-compute[76161]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 17:45:10 user nova-compute[76161]:           </cpus>
Nov 14 17:45:10 user nova-compute[76161]:         </cell>
Nov 14 17:45:10 user nova-compute[76161]:       </cells>
Nov 14 17:45:10 user nova-compute[76161]:     </topology>
Nov 14 17:45:10 user nova-compute[76161]:     <cache>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 17:45:10 user nova-compute[76161]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 17:45:10 user nova-compute[76161]:     </cache>
Nov 14 17:45:10 user nova-compute[76161]:     <secmodel>
Nov 14 17:45:10 user nova-compute[76161]:       <model>apparmor</model>
Nov 14 17:45:10 user nova-compute[76161]:       <doi>0</doi>
Nov 14 17:45:10 user nova-compute[76161]:     </secmodel>
Nov 14 17:45:10 user nova-compute[76161]:     <secmodel>
Nov 14 17:45:10 user nova-compute[76161]:       <model>dac</model>
Nov 14 17:45:10 user nova-compute[76161]:       <doi>0</doi>
Nov 14 17:45:10 user nova-compute[76161]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 17:45:10 user nova-compute[76161]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 17:45:10 user nova-compute[76161]:     </secmodel>
Nov 14 17:45:10 user nova-compute[76161]:   </host>
Nov 14 17:45:10 user nova-compute[76161]:   <guest>
Nov 14 17:45:10 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:10 user nova-compute[76161]:     <arch name='alpha'>
Nov 14 17:45:10 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:10 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>clipper</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:10 user nova-compute[76161]:     </arch>
Nov 14 17:45:10 user nova-compute[76161]:     <features>
Nov 14 17:45:10 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:10 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:10 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:10 user nova-compute[76161]:     </features>
Nov 14 17:45:10 user nova-compute[76161]:   </guest>
Nov 14 17:45:10 user nova-compute[76161]:   <guest>
Nov 14 17:45:10 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:10 user nova-compute[76161]:     <arch name='armv6l'>
Nov 14 17:45:10 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:10 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>spitz</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>nuri</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>kzm</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>sx1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>z2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>tosa</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>n810</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>n800</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>terrier</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>midway</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>microbit</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>verdex</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>highbank</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>akita</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>connex</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>collie</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:10 user nova-compute[76161]:     </arch>
Nov 14 17:45:10 user nova-compute[76161]:     <features>
Nov 14 17:45:10 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:10 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:10 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:10 user nova-compute[76161]:     </features>
Nov 14 17:45:10 user nova-compute[76161]:   </guest>
Nov 14 17:45:10 user nova-compute[76161]:   <guest>
Nov 14 17:45:10 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:10 user nova-compute[76161]:     <arch name='armv7l'>
Nov 14 17:45:10 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:10 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>spitz</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>nuri</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>kzm</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>sx1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>z2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>tosa</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>n810</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>n800</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>terrier</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>midway</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>microbit</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>verdex</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>highbank</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>akita</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>connex</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>collie</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:10 user nova-compute[76161]:     </arch>
Nov 14 17:45:10 user nova-compute[76161]:     <features>
Nov 14 17:45:10 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:10 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:10 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:10 user nova-compute[76161]:     </features>
Nov 14 17:45:10 user nova-compute[76161]:   </guest>
Nov 14 17:45:10 user nova-compute[76161]:   <guest>
Nov 14 17:45:10 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:10 user nova-compute[76161]:     <arch name='aarch64'>
Nov 14 17:45:10 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:10 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>spitz</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>nuri</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>kzm</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>sx1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>z2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>tosa</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>n810</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>n800</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>terrier</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>midway</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>microbit</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>verdex</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='4'>highbank</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>akita</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>connex</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>collie</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:10 user nova-compute[76161]:     </arch>
Nov 14 17:45:10 user nova-compute[76161]:     <features>
Nov 14 17:45:10 user nova-compute[76161]:       <acpi default='on' toggle='yes'/>
Nov 14 17:45:10 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:10 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:10 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:10 user nova-compute[76161]:     </features>
Nov 14 17:45:10 user nova-compute[76161]:   </guest>
Nov 14 17:45:10 user nova-compute[76161]:   <guest>
Nov 14 17:45:10 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:10 user nova-compute[76161]:     <arch name='cris'>
Nov 14 17:45:10 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:10 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:10 user nova-compute[76161]:     </arch>
Nov 14 17:45:10 user nova-compute[76161]:     <features>
Nov 14 17:45:10 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:10 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:10 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:10 user nova-compute[76161]:     </features>
Nov 14 17:45:10 user nova-compute[76161]:   </guest>
Nov 14 17:45:10 user nova-compute[76161]:   <guest>
Nov 14 17:45:10 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:10 user nova-compute[76161]:     <arch name='i686'>
Nov 14 17:45:10 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:10 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 17:45:10 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>isapc</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>microvm</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='kvm'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <pae/>
Nov 14 17:45:11 user nova-compute[76161]:       <nonpae/>
Nov 14 17:45:11 user nova-compute[76161]:       <acpi default='on' toggle='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:       <apic default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='m68k'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>an5206</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>q800</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='microblaze'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='microblazeel'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='mips'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='16'>malta</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='mipsel'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='16'>malta</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='mips64'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='16'>malta</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>pica61</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>magnum</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='mips64el'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='16'>malta</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>pica61</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>magnum</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='16'>boston</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='ppc'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>mac99</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>40p</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>taihu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='ppc64'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>taihu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>40p</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>mac99</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='ppc64le'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>taihu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>40p</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>mac99</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='riscv32'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='8'>spike</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='8'>virt</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='riscv64'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='8'>spike</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='8'>virt</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='s390x'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='sh4'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>shix</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>r2d</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='sh4eb'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>shix</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>r2d</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='sparc'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>LX</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='sparc64'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>niagara</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='x86_64'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>64</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='1'>isapc</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>microvm</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='kvm'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <acpi default='on' toggle='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:       <apic default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='xtensa'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='4'>sim</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>kc705</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>ml605</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>virt</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>lx200</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>lx60</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]:   <guest>
Nov 14 17:45:11 user nova-compute[76161]:     <os_type>hvm</os_type>
Nov 14 17:45:11 user nova-compute[76161]:     <arch name='xtensaeb'>
Nov 14 17:45:11 user nova-compute[76161]:       <wordsize>32</wordsize>
Nov 14 17:45:11 user nova-compute[76161]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='4'>sim</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>kc705</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>ml605</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>virt</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>lx200</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>lx60</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 17:45:11 user nova-compute[76161]:       <domain type='qemu'/>
Nov 14 17:45:11 user nova-compute[76161]:     </arch>
Nov 14 17:45:11 user nova-compute[76161]:     <features>
Nov 14 17:45:11 user nova-compute[76161]:       <cpuselection/>
Nov 14 17:45:11 user nova-compute[76161]:       <deviceboot/>
Nov 14 17:45:11 user nova-compute[76161]:       <disksnapshot default='on' toggle='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     </features>
Nov 14 17:45:11 user nova-compute[76161]:   </guest>
Nov 14 17:45:11 user nova-compute[76161]: </capabilities>
Nov 14 17:45:11 user nova-compute[76161]: 
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 17:45:11 user nova-compute[76161]: <domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 17:45:11 user nova-compute[76161]:   <domain>kvm</domain>
Nov 14 17:45:11 user nova-compute[76161]:   <machine>pc-i440fx-jammy</machine>
Nov 14 17:45:11 user nova-compute[76161]:   <arch>i686</arch>
Nov 14 17:45:11 user nova-compute[76161]:   <vcpu max='255'/>
Nov 14 17:45:11 user nova-compute[76161]:   <iothreads supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:   <os supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='firmware'/>
Nov 14 17:45:11 user nova-compute[76161]:     <loader supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>rom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pflash</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='readonly'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>yes</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='secure'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </loader>
Nov 14 17:45:11 user nova-compute[76161]:   </os>
Nov 14 17:45:11 user nova-compute[76161]:   <cpu>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-passthrough' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='hostPassthroughMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='maximum' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='maximumMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-model' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <vendor>Intel</vendor>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ss'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='vmx'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pcid'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='hypervisor'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arat'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='umip'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='md-clear'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibpb'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibrs'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='erms'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='lm'/>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='custom' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>qemu64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>qemu32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>phenom</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>n270</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>kvm64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>coreduo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>core2duo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>athlon</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Westmere</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Snowridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Penryn</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G5</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G4</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G1</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Nehalem</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Rome</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Milan</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Dhyana</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cooperlake</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Conroe</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>486</model>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:   </cpu>
Nov 14 17:45:11 user nova-compute[76161]:   <memoryBacking supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='sourceType'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>file</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>anonymous</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>memfd</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:   </memoryBacking>
Nov 14 17:45:11 user nova-compute[76161]:   <devices>
Nov 14 17:45:11 user nova-compute[76161]:     <disk supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='diskDevice'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>disk</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cdrom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>floppy</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>lun</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='bus'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ide</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>fdc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sata</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </disk>
Nov 14 17:45:11 user nova-compute[76161]:     <graphics supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sdl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vnc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>spice</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egl-headless</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </graphics>
Nov 14 17:45:11 user nova-compute[76161]:     <video supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='modelType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cirrus</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vmvga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>qxl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>none</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>bochs</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ramfb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </video>
Nov 14 17:45:11 user nova-compute[76161]:     <hostdev supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='mode'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>subsystem</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='startupPolicy'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>default</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>mandatory</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>requisite</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>optional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='subsysType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pci</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='capsType'/>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='pciBackend'/>
Nov 14 17:45:11 user nova-compute[76161]:     </hostdev>
Nov 14 17:45:11 user nova-compute[76161]:     <rng supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>random</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egd</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>builtin</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </rng>
Nov 14 17:45:11 user nova-compute[76161]:     <filesystem supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='driverType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>path</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>handle</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtiofs</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </filesystem>
Nov 14 17:45:11 user nova-compute[76161]:     <tpm supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-tis</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-crb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>passthrough</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>emulator</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </tpm>
Nov 14 17:45:11 user nova-compute[76161]:   </devices>
Nov 14 17:45:11 user nova-compute[76161]:   <features>
Nov 14 17:45:11 user nova-compute[76161]:     <gic supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     <vmcoreinfo supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <genid supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backingStoreInput supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backup supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <sev supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:   </features>
Nov 14 17:45:11 user nova-compute[76161]: </domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:  {{(pid=76161) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 17:45:11 user nova-compute[76161]: <domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 17:45:11 user nova-compute[76161]:   <domain>kvm</domain>
Nov 14 17:45:11 user nova-compute[76161]:   <machine>pc-q35-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:   <arch>i686</arch>
Nov 14 17:45:11 user nova-compute[76161]:   <vcpu max='288'/>
Nov 14 17:45:11 user nova-compute[76161]:   <iothreads supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:   <os supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='firmware'/>
Nov 14 17:45:11 user nova-compute[76161]:     <loader supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>rom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pflash</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='readonly'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>yes</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='secure'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </loader>
Nov 14 17:45:11 user nova-compute[76161]:   </os>
Nov 14 17:45:11 user nova-compute[76161]:   <cpu>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-passthrough' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='hostPassthroughMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='maximum' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='maximumMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-model' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <vendor>Intel</vendor>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ss'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='vmx'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pcid'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='hypervisor'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arat'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='umip'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='md-clear'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibpb'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibrs'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='erms'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='lm'/>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='custom' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>qemu64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>qemu32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>phenom</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>n270</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>kvm64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>coreduo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>core2duo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>athlon</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Westmere</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Snowridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Penryn</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G5</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G4</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G1</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Nehalem</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Rome</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Milan</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Dhyana</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cooperlake</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Conroe</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>486</model>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:   </cpu>
Nov 14 17:45:11 user nova-compute[76161]:   <memoryBacking supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='sourceType'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>file</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>anonymous</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>memfd</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:   </memoryBacking>
Nov 14 17:45:11 user nova-compute[76161]:   <devices>
Nov 14 17:45:11 user nova-compute[76161]:     <disk supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='diskDevice'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>disk</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cdrom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>floppy</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>lun</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='bus'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>fdc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sata</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </disk>
Nov 14 17:45:11 user nova-compute[76161]:     <graphics supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sdl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vnc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>spice</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egl-headless</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </graphics>
Nov 14 17:45:11 user nova-compute[76161]:     <video supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='modelType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cirrus</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vmvga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>qxl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>none</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>bochs</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ramfb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </video>
Nov 14 17:45:11 user nova-compute[76161]:     <hostdev supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='mode'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>subsystem</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='startupPolicy'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>default</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>mandatory</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>requisite</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>optional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='subsysType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pci</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='capsType'/>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='pciBackend'/>
Nov 14 17:45:11 user nova-compute[76161]:     </hostdev>
Nov 14 17:45:11 user nova-compute[76161]:     <rng supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>random</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egd</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>builtin</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </rng>
Nov 14 17:45:11 user nova-compute[76161]:     <filesystem supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='driverType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>path</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>handle</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtiofs</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </filesystem>
Nov 14 17:45:11 user nova-compute[76161]:     <tpm supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-tis</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-crb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>passthrough</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>emulator</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </tpm>
Nov 14 17:45:11 user nova-compute[76161]:   </devices>
Nov 14 17:45:11 user nova-compute[76161]:   <features>
Nov 14 17:45:11 user nova-compute[76161]:     <gic supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     <vmcoreinfo supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <genid supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backingStoreInput supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backup supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <sev supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:   </features>
Nov 14 17:45:11 user nova-compute[76161]: </domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:  {{(pid=76161) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 17:45:11 user nova-compute[76161]: <domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 17:45:11 user nova-compute[76161]:   <domain>kvm</domain>
Nov 14 17:45:11 user nova-compute[76161]:   <machine>pc-i440fx-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:   <arch>i686</arch>
Nov 14 17:45:11 user nova-compute[76161]:   <vcpu max='255'/>
Nov 14 17:45:11 user nova-compute[76161]:   <iothreads supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:   <os supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='firmware'/>
Nov 14 17:45:11 user nova-compute[76161]:     <loader supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>rom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pflash</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='readonly'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>yes</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='secure'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </loader>
Nov 14 17:45:11 user nova-compute[76161]:   </os>
Nov 14 17:45:11 user nova-compute[76161]:   <cpu>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-passthrough' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='hostPassthroughMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='maximum' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='maximumMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-model' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <vendor>Intel</vendor>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ss'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='vmx'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pcid'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='hypervisor'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arat'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='umip'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='md-clear'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibpb'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibrs'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='erms'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='lm'/>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='custom' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>qemu64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>qemu32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>phenom</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>n270</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>kvm64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>coreduo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>core2duo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>athlon</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Westmere</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Snowridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Penryn</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G5</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G4</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G1</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Nehalem</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Rome</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Milan</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Dhyana</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cooperlake</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Conroe</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>486</model>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:   </cpu>
Nov 14 17:45:11 user nova-compute[76161]:   <memoryBacking supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='sourceType'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>file</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>anonymous</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>memfd</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:   </memoryBacking>
Nov 14 17:45:11 user nova-compute[76161]:   <devices>
Nov 14 17:45:11 user nova-compute[76161]:     <disk supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='diskDevice'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>disk</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cdrom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>floppy</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>lun</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='bus'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ide</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>fdc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sata</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </disk>
Nov 14 17:45:11 user nova-compute[76161]:     <graphics supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sdl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vnc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>spice</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egl-headless</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </graphics>
Nov 14 17:45:11 user nova-compute[76161]:     <video supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='modelType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cirrus</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vmvga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>qxl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>none</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>bochs</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ramfb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </video>
Nov 14 17:45:11 user nova-compute[76161]:     <hostdev supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='mode'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>subsystem</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='startupPolicy'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>default</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>mandatory</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>requisite</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>optional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='subsysType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pci</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='capsType'/>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='pciBackend'/>
Nov 14 17:45:11 user nova-compute[76161]:     </hostdev>
Nov 14 17:45:11 user nova-compute[76161]:     <rng supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>random</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egd</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>builtin</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </rng>
Nov 14 17:45:11 user nova-compute[76161]:     <filesystem supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='driverType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>path</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>handle</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtiofs</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </filesystem>
Nov 14 17:45:11 user nova-compute[76161]:     <tpm supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-tis</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-crb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>passthrough</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>emulator</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </tpm>
Nov 14 17:45:11 user nova-compute[76161]:   </devices>
Nov 14 17:45:11 user nova-compute[76161]:   <features>
Nov 14 17:45:11 user nova-compute[76161]:     <gic supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     <vmcoreinfo supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <genid supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backingStoreInput supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backup supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <sev supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:   </features>
Nov 14 17:45:11 user nova-compute[76161]: </domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:  {{(pid=76161) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 17:45:11 user nova-compute[76161]: <domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 17:45:11 user nova-compute[76161]:   <domain>kvm</domain>
Nov 14 17:45:11 user nova-compute[76161]:   <machine>pc-q35-jammy</machine>
Nov 14 17:45:11 user nova-compute[76161]:   <arch>i686</arch>
Nov 14 17:45:11 user nova-compute[76161]:   <vcpu max='288'/>
Nov 14 17:45:11 user nova-compute[76161]:   <iothreads supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:   <os supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='firmware'/>
Nov 14 17:45:11 user nova-compute[76161]:     <loader supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>rom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pflash</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='readonly'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>yes</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='secure'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </loader>
Nov 14 17:45:11 user nova-compute[76161]:   </os>
Nov 14 17:45:11 user nova-compute[76161]:   <cpu>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-passthrough' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='hostPassthroughMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='maximum' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='maximumMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-model' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <vendor>Intel</vendor>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ss'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='vmx'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pcid'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='hypervisor'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arat'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='umip'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='md-clear'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibpb'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibrs'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='erms'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='lm'/>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='custom' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>qemu64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>qemu32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>phenom</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>n270</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>kvm64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>coreduo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>core2duo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>athlon</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Westmere</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Snowridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Penryn</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G5</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G4</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G1</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Nehalem</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Rome</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Milan</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Dhyana</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cooperlake</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Conroe</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>486</model>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:   </cpu>
Nov 14 17:45:11 user nova-compute[76161]:   <memoryBacking supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='sourceType'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>file</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>anonymous</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>memfd</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:   </memoryBacking>
Nov 14 17:45:11 user nova-compute[76161]:   <devices>
Nov 14 17:45:11 user nova-compute[76161]:     <disk supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='diskDevice'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>disk</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cdrom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>floppy</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>lun</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='bus'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>fdc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sata</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </disk>
Nov 14 17:45:11 user nova-compute[76161]:     <graphics supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sdl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vnc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>spice</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egl-headless</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </graphics>
Nov 14 17:45:11 user nova-compute[76161]:     <video supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='modelType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cirrus</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vmvga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>qxl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>none</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>bochs</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ramfb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </video>
Nov 14 17:45:11 user nova-compute[76161]:     <hostdev supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='mode'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>subsystem</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='startupPolicy'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>default</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>mandatory</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>requisite</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>optional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='subsysType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pci</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='capsType'/>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='pciBackend'/>
Nov 14 17:45:11 user nova-compute[76161]:     </hostdev>
Nov 14 17:45:11 user nova-compute[76161]:     <rng supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>random</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egd</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>builtin</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </rng>
Nov 14 17:45:11 user nova-compute[76161]:     <filesystem supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='driverType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>path</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>handle</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtiofs</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </filesystem>
Nov 14 17:45:11 user nova-compute[76161]:     <tpm supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-tis</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-crb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>passthrough</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>emulator</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </tpm>
Nov 14 17:45:11 user nova-compute[76161]:   </devices>
Nov 14 17:45:11 user nova-compute[76161]:   <features>
Nov 14 17:45:11 user nova-compute[76161]:     <gic supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     <vmcoreinfo supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <genid supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backingStoreInput supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backup supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <sev supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:   </features>
Nov 14 17:45:11 user nova-compute[76161]: </domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:  {{(pid=76161) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 17:45:11 user nova-compute[76161]: <domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 17:45:11 user nova-compute[76161]:   <domain>kvm</domain>
Nov 14 17:45:11 user nova-compute[76161]:   <machine>pc-i440fx-jammy</machine>
Nov 14 17:45:11 user nova-compute[76161]:   <arch>x86_64</arch>
Nov 14 17:45:11 user nova-compute[76161]:   <vcpu max='255'/>
Nov 14 17:45:11 user nova-compute[76161]:   <iothreads supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:   <os supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='firmware'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>efi</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:     <loader supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>rom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pflash</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='readonly'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>yes</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='secure'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </loader>
Nov 14 17:45:11 user nova-compute[76161]:   </os>
Nov 14 17:45:11 user nova-compute[76161]:   <cpu>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-passthrough' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='hostPassthroughMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='maximum' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='maximumMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-model' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <vendor>Intel</vendor>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ss'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='vmx'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pcid'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='hypervisor'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arat'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='umip'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='md-clear'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='invtsc'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibpb'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibrs'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='rsba'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='erms'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='custom' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>qemu64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>qemu32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>phenom</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>n270</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>coreduo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>core2duo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>athlon</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Westmere</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Snowridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Penryn</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G5</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G4</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Opteron_G1</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Nehalem</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Rome</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Milan</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Dhyana</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cooperlake</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Conroe</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>486</model>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:   </cpu>
Nov 14 17:45:11 user nova-compute[76161]:   <memoryBacking supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='sourceType'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>file</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>anonymous</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>memfd</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:   </memoryBacking>
Nov 14 17:45:11 user nova-compute[76161]:   <devices>
Nov 14 17:45:11 user nova-compute[76161]:     <disk supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='diskDevice'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>disk</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cdrom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>floppy</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>lun</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='bus'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ide</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>fdc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sata</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </disk>
Nov 14 17:45:11 user nova-compute[76161]:     <graphics supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sdl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vnc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>spice</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egl-headless</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </graphics>
Nov 14 17:45:11 user nova-compute[76161]:     <video supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='modelType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cirrus</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vmvga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>qxl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>none</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>bochs</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ramfb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </video>
Nov 14 17:45:11 user nova-compute[76161]:     <hostdev supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='mode'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>subsystem</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='startupPolicy'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>default</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>mandatory</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>requisite</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>optional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='subsysType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pci</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='capsType'/>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='pciBackend'/>
Nov 14 17:45:11 user nova-compute[76161]:     </hostdev>
Nov 14 17:45:11 user nova-compute[76161]:     <rng supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>random</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egd</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>builtin</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </rng>
Nov 14 17:45:11 user nova-compute[76161]:     <filesystem supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='driverType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>path</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>handle</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtiofs</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </filesystem>
Nov 14 17:45:11 user nova-compute[76161]:     <tpm supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-tis</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-crb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>passthrough</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>emulator</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </tpm>
Nov 14 17:45:11 user nova-compute[76161]:   </devices>
Nov 14 17:45:11 user nova-compute[76161]:   <features>
Nov 14 17:45:11 user nova-compute[76161]:     <gic supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     <vmcoreinfo supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <genid supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backingStoreInput supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backup supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <sev supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:   </features>
Nov 14 17:45:11 user nova-compute[76161]: </domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:  {{(pid=76161) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 17:45:11 user nova-compute[76161]: <domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 17:45:11 user nova-compute[76161]:   <domain>kvm</domain>
Nov 14 17:45:11 user nova-compute[76161]:   <machine>pc-q35-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:   <arch>x86_64</arch>
Nov 14 17:45:11 user nova-compute[76161]:   <vcpu max='288'/>
Nov 14 17:45:11 user nova-compute[76161]:   <iothreads supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:   <os supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='firmware'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>efi</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:     <loader supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>rom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pflash</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='readonly'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>yes</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='secure'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>yes</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </loader>
Nov 14 17:45:11 user nova-compute[76161]:   </os>
Nov 14 17:45:11 user nova-compute[76161]:   <cpu>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-passthrough' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='hostPassthroughMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='maximum' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='maximumMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-model' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <vendor>Intel</vendor>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ss'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='vmx'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pcid'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='hypervisor'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arat'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='umip'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='md-clear'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='invtsc'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibpb'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibrs'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='rsba'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='erms'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='custom' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>qemu64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>qemu32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>phenom</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>n270</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>coreduo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>core2duo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>athlon</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Westmere</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Snowridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Penryn</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G5</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G4</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Opteron_G1</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Nehalem</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Rome</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Milan</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Dhyana</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cooperlake</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Conroe</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>486</model>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:   </cpu>
Nov 14 17:45:11 user nova-compute[76161]:   <memoryBacking supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='sourceType'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>file</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>anonymous</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>memfd</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:   </memoryBacking>
Nov 14 17:45:11 user nova-compute[76161]:   <devices>
Nov 14 17:45:11 user nova-compute[76161]:     <disk supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='diskDevice'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>disk</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cdrom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>floppy</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>lun</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='bus'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>fdc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sata</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </disk>
Nov 14 17:45:11 user nova-compute[76161]:     <graphics supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sdl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vnc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>spice</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egl-headless</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </graphics>
Nov 14 17:45:11 user nova-compute[76161]:     <video supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='modelType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cirrus</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vmvga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>qxl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>none</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>bochs</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ramfb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </video>
Nov 14 17:45:11 user nova-compute[76161]:     <hostdev supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='mode'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>subsystem</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='startupPolicy'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>default</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>mandatory</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>requisite</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>optional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='subsysType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pci</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='capsType'/>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='pciBackend'/>
Nov 14 17:45:11 user nova-compute[76161]:     </hostdev>
Nov 14 17:45:11 user nova-compute[76161]:     <rng supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>random</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egd</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>builtin</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </rng>
Nov 14 17:45:11 user nova-compute[76161]:     <filesystem supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='driverType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>path</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>handle</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtiofs</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </filesystem>
Nov 14 17:45:11 user nova-compute[76161]:     <tpm supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-tis</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-crb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>passthrough</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>emulator</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </tpm>
Nov 14 17:45:11 user nova-compute[76161]:   </devices>
Nov 14 17:45:11 user nova-compute[76161]:   <features>
Nov 14 17:45:11 user nova-compute[76161]:     <gic supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     <vmcoreinfo supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <genid supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backingStoreInput supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backup supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <sev supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:   </features>
Nov 14 17:45:11 user nova-compute[76161]: </domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:  {{(pid=76161) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 17:45:11 user nova-compute[76161]: <domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 17:45:11 user nova-compute[76161]:   <domain>kvm</domain>
Nov 14 17:45:11 user nova-compute[76161]:   <machine>pc-i440fx-6.2</machine>
Nov 14 17:45:11 user nova-compute[76161]:   <arch>x86_64</arch>
Nov 14 17:45:11 user nova-compute[76161]:   <vcpu max='255'/>
Nov 14 17:45:11 user nova-compute[76161]:   <iothreads supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:   <os supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='firmware'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>efi</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:     <loader supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>rom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pflash</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='readonly'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>yes</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='secure'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </loader>
Nov 14 17:45:11 user nova-compute[76161]:   </os>
Nov 14 17:45:11 user nova-compute[76161]:   <cpu>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-passthrough' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='hostPassthroughMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='maximum' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='maximumMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-model' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <vendor>Intel</vendor>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ss'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='vmx'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pcid'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='hypervisor'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arat'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='umip'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='md-clear'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='invtsc'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibpb'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibrs'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='rsba'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='erms'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='custom' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>qemu64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>qemu32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>phenom</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>n270</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>coreduo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>core2duo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>athlon</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Westmere</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Snowridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Penryn</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G5</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G4</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Opteron_G1</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Nehalem</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Rome</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Milan</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Dhyana</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cooperlake</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Conroe</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>486</model>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:   </cpu>
Nov 14 17:45:11 user nova-compute[76161]:   <memoryBacking supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='sourceType'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>file</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>anonymous</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>memfd</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:   </memoryBacking>
Nov 14 17:45:11 user nova-compute[76161]:   <devices>
Nov 14 17:45:11 user nova-compute[76161]:     <disk supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='diskDevice'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>disk</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cdrom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>floppy</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>lun</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='bus'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ide</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>fdc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sata</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </disk>
Nov 14 17:45:11 user nova-compute[76161]:     <graphics supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sdl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vnc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>spice</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egl-headless</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </graphics>
Nov 14 17:45:11 user nova-compute[76161]:     <video supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='modelType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cirrus</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vmvga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>qxl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>none</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>bochs</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ramfb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </video>
Nov 14 17:45:11 user nova-compute[76161]:     <hostdev supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='mode'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>subsystem</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='startupPolicy'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>default</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>mandatory</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>requisite</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>optional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='subsysType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pci</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='capsType'/>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='pciBackend'/>
Nov 14 17:45:11 user nova-compute[76161]:     </hostdev>
Nov 14 17:45:11 user nova-compute[76161]:     <rng supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>random</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egd</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>builtin</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </rng>
Nov 14 17:45:11 user nova-compute[76161]:     <filesystem supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='driverType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>path</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>handle</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtiofs</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </filesystem>
Nov 14 17:45:11 user nova-compute[76161]:     <tpm supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-tis</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-crb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>passthrough</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>emulator</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </tpm>
Nov 14 17:45:11 user nova-compute[76161]:   </devices>
Nov 14 17:45:11 user nova-compute[76161]:   <features>
Nov 14 17:45:11 user nova-compute[76161]:     <gic supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     <vmcoreinfo supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <genid supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backingStoreInput supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backup supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <sev supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:   </features>
Nov 14 17:45:11 user nova-compute[76161]: </domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:  {{(pid=76161) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 17:45:11 user nova-compute[76161]: <domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 17:45:11 user nova-compute[76161]:   <domain>kvm</domain>
Nov 14 17:45:11 user nova-compute[76161]:   <machine>pc-q35-jammy</machine>
Nov 14 17:45:11 user nova-compute[76161]:   <arch>x86_64</arch>
Nov 14 17:45:11 user nova-compute[76161]:   <vcpu max='288'/>
Nov 14 17:45:11 user nova-compute[76161]:   <iothreads supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:   <os supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='firmware'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>efi</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:     <loader supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>rom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pflash</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='readonly'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>yes</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='secure'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>yes</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>no</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </loader>
Nov 14 17:45:11 user nova-compute[76161]:   </os>
Nov 14 17:45:11 user nova-compute[76161]:   <cpu>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-passthrough' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='hostPassthroughMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='maximum' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='maximumMigratable'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>on</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>off</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='host-model' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <vendor>Intel</vendor>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ss'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='vmx'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pcid'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='hypervisor'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arat'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='umip'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='md-clear'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='invtsc'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibpb'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='ibrs'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-stibp'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='rsba'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='erms'/>
Nov 14 17:45:11 user nova-compute[76161]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:     <mode name='custom' supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>qemu64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>qemu32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>phenom</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>pentium</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>n270</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm64</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>kvm32</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>coreduo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>core2duo</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>athlon</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Westmere</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Snowridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Skylake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>SandyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Penryn</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G5</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G4</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G3</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Opteron_G2</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Opteron_G1</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Nehalem</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>IvyBridge</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Icelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Haswell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Rome</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-Milan</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>EPYC</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Dhyana</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cooperlake</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>Conroe</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='no'>Broadwell</model>
Nov 14 17:45:11 user nova-compute[76161]:       <model usable='yes'>486</model>
Nov 14 17:45:11 user nova-compute[76161]:     </mode>
Nov 14 17:45:11 user nova-compute[76161]:   </cpu>
Nov 14 17:45:11 user nova-compute[76161]:   <memoryBacking supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:     <enum name='sourceType'>
Nov 14 17:45:11 user nova-compute[76161]:       <value>file</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>anonymous</value>
Nov 14 17:45:11 user nova-compute[76161]:       <value>memfd</value>
Nov 14 17:45:11 user nova-compute[76161]:     </enum>
Nov 14 17:45:11 user nova-compute[76161]:   </memoryBacking>
Nov 14 17:45:11 user nova-compute[76161]:   <devices>
Nov 14 17:45:11 user nova-compute[76161]:     <disk supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='diskDevice'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>disk</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cdrom</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>floppy</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>lun</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='bus'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>fdc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sata</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </disk>
Nov 14 17:45:11 user nova-compute[76161]:     <graphics supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='type'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>sdl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vnc</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>spice</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egl-headless</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </graphics>
Nov 14 17:45:11 user nova-compute[76161]:     <video supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='modelType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>cirrus</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>vmvga</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>qxl</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>none</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>bochs</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>ramfb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </video>
Nov 14 17:45:11 user nova-compute[76161]:     <hostdev supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='mode'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>subsystem</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='startupPolicy'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>default</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>mandatory</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>requisite</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>optional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='subsysType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>usb</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>pci</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>scsi</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='capsType'/>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='pciBackend'/>
Nov 14 17:45:11 user nova-compute[76161]:     </hostdev>
Nov 14 17:45:11 user nova-compute[76161]:     <rng supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtio-non-transitional</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>random</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>egd</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>builtin</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </rng>
Nov 14 17:45:11 user nova-compute[76161]:     <filesystem supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='driverType'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>path</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>handle</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>virtiofs</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </filesystem>
Nov 14 17:45:11 user nova-compute[76161]:     <tpm supported='yes'>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='model'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-tis</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>tpm-crb</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:       <enum name='backendModel'>
Nov 14 17:45:11 user nova-compute[76161]:         <value>passthrough</value>
Nov 14 17:45:11 user nova-compute[76161]:         <value>emulator</value>
Nov 14 17:45:11 user nova-compute[76161]:       </enum>
Nov 14 17:45:11 user nova-compute[76161]:     </tpm>
Nov 14 17:45:11 user nova-compute[76161]:   </devices>
Nov 14 17:45:11 user nova-compute[76161]:   <features>
Nov 14 17:45:11 user nova-compute[76161]:     <gic supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:     <vmcoreinfo supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <genid supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backingStoreInput supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <backup supported='yes'/>
Nov 14 17:45:11 user nova-compute[76161]:     <sev supported='no'/>
Nov 14 17:45:11 user nova-compute[76161]:   </features>
Nov 14 17:45:11 user nova-compute[76161]: </domainCapabilities>
Nov 14 17:45:11 user nova-compute[76161]:  {{(pid=76161) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=76161) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=76161) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Checking secure boot support for host arch (x86_64) {{(pid=76161) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Checking secure boot support for host arch (x86_64) {{(pid=76161) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Checking secure boot support for host arch (x86_64) {{(pid=76161) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 17:45:11 user nova-compute[76161]: INFO nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Secure Boot support detected
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] cpu compare xml: <cpu match="exact">
Nov 14 17:45:11 user nova-compute[76161]:   <model>Nehalem</model>
Nov 14 17:45:11 user nova-compute[76161]: </cpu>
Nov 14 17:45:11 user nova-compute[76161]:  {{(pid=76161) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 17:45:11 user nova-compute[76161]: INFO nova.virt.node [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Generated node identity eef4e2ad-d4c6-40c7-9f76-0a052858d5fd
Nov 14 17:45:11 user nova-compute[76161]: INFO nova.virt.node [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Wrote node identity eef4e2ad-d4c6-40c7-9f76-0a052858d5fd to /opt/stack/data/nova/compute_id
Nov 14 17:45:11 user nova-compute[76161]: WARNING nova.compute.manager [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Compute nodes ['eef4e2ad-d4c6-40c7-9f76-0a052858d5fd'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 17:45:11 user nova-compute[76161]: INFO nova.compute.manager [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 17:45:11 user nova-compute[76161]: WARNING nova.compute.manager [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 17:45:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:45:11 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:45:11 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Hypervisor/Node resource view: name=user free_ram=10976MB free_disk=26.18431854248047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:45:11 user nova-compute[76161]: WARNING nova.compute.resource_tracker [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] No compute node record for user:eef4e2ad-d4c6-40c7-9f76-0a052858d5fd: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host eef4e2ad-d4c6-40c7-9f76-0a052858d5fd could not be found.
Nov 14 17:45:11 user nova-compute[76161]: INFO nova.compute.resource_tracker [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Compute node record created for user:user with uuid: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:45:11 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] [req-083dff7a-9083-45fb-98e7-f07c5f8a0f20] Created resource provider record via placement API for resource provider with UUID eef4e2ad-d4c6-40c7-9f76-0a052858d5fd and name user.
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=76161) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 17:45:11 user nova-compute[76161]: INFO nova.virt.libvirt.host [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] kernel doesn't support AMD SEV
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Libvirt baseline CPU <cpu>
Nov 14 17:45:11 user nova-compute[76161]:   <arch>x86_64</arch>
Nov 14 17:45:11 user nova-compute[76161]:   <model>Nehalem</model>
Nov 14 17:45:11 user nova-compute[76161]:   <vendor>Intel</vendor>
Nov 14 17:45:11 user nova-compute[76161]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 17:45:11 user nova-compute[76161]: </cpu>
Nov 14 17:45:11 user nova-compute[76161]:  {{(pid=76161) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Updated inventory for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Updating resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd generation from 0 to 1 during operation: update_inventory {{(pid=76161) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 17:45:11 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 17:45:12 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Updating resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd generation from 1 to 2 during operation: update_traits {{(pid=76161) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 17:45:12 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:45:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:45:12 user nova-compute[76161]: DEBUG nova.service [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Creating RPC server for service compute {{(pid=76161) start /opt/stack/nova/nova/service.py:182}}
Nov 14 17:45:12 user nova-compute[76161]: DEBUG nova.service [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] Join ServiceGroup membership for this service compute {{(pid=76161) start /opt/stack/nova/nova/service.py:199}}
Nov 14 17:45:12 user nova-compute[76161]: DEBUG nova.servicegroup.drivers.db [None req-eb2c5d8f-dc10-4946-99bf-3d98a7e9d7a6 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=76161) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 17:45:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:45:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:46:03 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:46:03 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=10398MB free_disk=26.088176727294922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:46:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:47:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:47:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:47:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:47:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:47:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:47:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:47:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:47:03 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:47:03 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:47:03 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:47:03 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=10339MB free_disk=26.15249252319336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:47:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:47:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:47:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:47:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:47:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:48:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:48:04 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:48:05 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:48:05 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=10378MB free_disk=25.90494155883789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:48:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:48:06 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:49:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:49:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 17:49:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:06 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:06 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:06 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:06 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:49:07 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:07 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:07 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=9646MB free_disk=25.925140380859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:49:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:49:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:49:12 user nova-compute[76161]: INFO nova.compute.claims [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Claim successful on node user
Nov 14 17:49:12 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:49:12 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:49:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:49:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:49:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:49:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Creating image(s)
Nov 14 17:49:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "/opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "/opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "/opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG nova.policy [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4714975d06d8455788463a30e9bc5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69696059b86f44b7ae274bf8274f9843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d.part --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d.part --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG nova.virt.images [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] 1804ef46-1f05-4c8f-910b-8e52c7b69935 was qcow2, converting to raw {{(pid=76161) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 17:49:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d.part /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d.converted {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d.part /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d.converted" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d.converted --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.085s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:14 user nova-compute[76161]: INFO oslo.privsep.daemon [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn1ih_mt7/privsep.sock']
Nov 14 17:49:14 user sudo[85401]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn1ih_mt7/privsep.sock
Nov 14 17:49:14 user sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 17:49:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:49:15 user nova-compute[76161]: INFO nova.compute.claims [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Claim successful on node user
Nov 14 17:49:15 user sudo[85401]: pam_unix(sudo:session): session closed for user root
Nov 14 17:49:15 user nova-compute[76161]: INFO oslo.privsep.daemon [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Spawned new privsep daemon via rootwrap
Nov 14 17:49:15 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 17:49:15 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 17:49:15 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 17:49:15 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85421
Nov 14 17:49:15 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:15 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.383s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:49:16 user nova-compute[76161]: INFO nova.compute.claims [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Claim successful on node user
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.161s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Successfully created port: f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.195s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk 1073741824" returned: 0 in 0.057s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:49:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Creating image(s)
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "/opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "/opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.policy [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '983ee707e2eb4a2ba4617f91d810011d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68afcd8a90ba42bd860204d31efae7e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:49:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.160s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Cannot resize image /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Ensure instance console log exists: /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:49:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Creating image(s)
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "/opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "/opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG nova.policy [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f5c7bf573614b7dbed7484623bbdddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d92618d87174e86a36acfb7d069a698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk 1073741824" returned: 0 in 0.042s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Cannot resize image /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Ensure instance console log exists: /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk 1073741824" returned: 0 in 0.048s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Cannot resize image /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Ensure instance console log exists: /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:18 user nova-compute[76161]: DEBUG nova.network.neutron [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Successfully created port: 670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:49:18 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Successfully created port: 1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:49:19 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Successfully updated port: f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquired lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:49:20 user nova-compute[76161]: INFO nova.compute.claims [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Claim successful on node user
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:49:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-011f8099-9b4f-4b9c-83ea-8531a0f64a2d req-862c3350-39e4-40df-93fb-2069426c9b69 service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Received event network-changed-f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-011f8099-9b4f-4b9c-83ea-8531a0f64a2d req-862c3350-39e4-40df-93fb-2069426c9b69 service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Refreshing instance network info cache due to event network-changed-f023f734-0b61-461c-b3ab-100bcf5706b6. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-011f8099-9b4f-4b9c-83ea-8531a0f64a2d req-862c3350-39e4-40df-93fb-2069426c9b69 service nova] Acquiring lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:49:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Creating image(s)
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "/opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "/opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "/opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG nova.policy [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdcf024ba5d2481aad966acad37d9275', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05c015b22d142de91f43f92f00fe8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:49:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.195s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk 1073741824" returned: 0 in 0.040s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Successfully updated port: 670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquired lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Updating instance_info_cache with network_info: [{"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Releasing lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Instance network_info: |[{"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-011f8099-9b4f-4b9c-83ea-8531a0f64a2d req-862c3350-39e4-40df-93fb-2069426c9b69 service nova] Acquired lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.neutron [req-011f8099-9b4f-4b9c-83ea-8531a0f64a2d req-862c3350-39e4-40df-93fb-2069426c9b69 service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Refreshing network info cache for port f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Start _get_guest_xml network_info=[{"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:49:21 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:21 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2089056756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2089056756',id=1,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-cfswyfga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:13Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=bed4f7a2-be4f-4c3a-a925-4c8b65105fb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=f023f734-0b61-461c-b3ab-100bcf5706b6,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023f734-0b') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.objects.instance [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'pci_devices' on Instance uuid bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.206s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:49:21 user nova-compute[76161]:   <uuid>bed4f7a2-be4f-4c3a-a925-4c8b65105fb0</uuid>
Nov 14 17:49:21 user nova-compute[76161]:   <name>instance-00000001</name>
Nov 14 17:49:21 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:49:21 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:49:21 user nova-compute[76161]:   <metadata>
Nov 14 17:49:21 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:49:21 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:49:21 user nova-compute[76161]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2089056756</nova:name>
Nov 14 17:49:21 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:49:21</nova:creationTime>
Nov 14 17:49:21 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:49:21 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:49:21 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:49:21 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:49:21 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:49:21 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:49:21 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:49:21 user nova-compute[76161]:       <nova:owner>
Nov 14 17:49:21 user nova-compute[76161]:         <nova:user uuid="4714975d06d8455788463a30e9bc5faa">tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member</nova:user>
Nov 14 17:49:21 user nova-compute[76161]:         <nova:project uuid="69696059b86f44b7ae274bf8274f9843">tempest-ServerBootFromVolumeStableRescueTest-500586355</nova:project>
Nov 14 17:49:21 user nova-compute[76161]:       </nova:owner>
Nov 14 17:49:21 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:49:21 user nova-compute[76161]:       <nova:ports>
Nov 14 17:49:21 user nova-compute[76161]:         <nova:port uuid="f023f734-0b61-461c-b3ab-100bcf5706b6">
Nov 14 17:49:21 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 17:49:21 user nova-compute[76161]:         </nova:port>
Nov 14 17:49:21 user nova-compute[76161]:       </nova:ports>
Nov 14 17:49:21 user nova-compute[76161]:     </nova:instance>
Nov 14 17:49:21 user nova-compute[76161]:   </metadata>
Nov 14 17:49:21 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:49:21 user nova-compute[76161]:     <system>
Nov 14 17:49:21 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:49:21 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:49:21 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:49:21 user nova-compute[76161]:       <entry name="serial">bed4f7a2-be4f-4c3a-a925-4c8b65105fb0</entry>
Nov 14 17:49:21 user nova-compute[76161]:       <entry name="uuid">bed4f7a2-be4f-4c3a-a925-4c8b65105fb0</entry>
Nov 14 17:49:21 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:49:21 user nova-compute[76161]:     </system>
Nov 14 17:49:21 user nova-compute[76161]:   </sysinfo>
Nov 14 17:49:21 user nova-compute[76161]:   <os>
Nov 14 17:49:21 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:49:21 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:49:21 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:49:21 user nova-compute[76161]:   </os>
Nov 14 17:49:21 user nova-compute[76161]:   <features>
Nov 14 17:49:21 user nova-compute[76161]:     <acpi/>
Nov 14 17:49:21 user nova-compute[76161]:     <apic/>
Nov 14 17:49:21 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:49:21 user nova-compute[76161]:   </features>
Nov 14 17:49:21 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:49:21 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:49:21 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:49:21 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:49:21 user nova-compute[76161]:   </clock>
Nov 14 17:49:21 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:49:21 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:49:21 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:49:21 user nova-compute[76161]:   </cpu>
Nov 14 17:49:21 user nova-compute[76161]:   <devices>
Nov 14 17:49:21 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:49:21 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:49:21 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk"/>
Nov 14 17:49:21 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:49:21 user nova-compute[76161]:     </disk>
Nov 14 17:49:21 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:49:21 user nova-compute[76161]:       <mac address="fa:16:3e:f4:e1:31"/>
Nov 14 17:49:21 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:21 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:49:21 user nova-compute[76161]:       <target dev="tapf023f734-0b"/>
Nov 14 17:49:21 user nova-compute[76161]:     </interface>
Nov 14 17:49:21 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:49:21 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/console.log" append="off"/>
Nov 14 17:49:21 user nova-compute[76161]:     </serial>
Nov 14 17:49:21 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:49:21 user nova-compute[76161]:     <video>
Nov 14 17:49:21 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:21 user nova-compute[76161]:     </video>
Nov 14 17:49:21 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:49:21 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:49:21 user nova-compute[76161]:     </rng>
Nov 14 17:49:21 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:49:21 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:49:21 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:49:21 user nova-compute[76161]:     </memballoon>
Nov 14 17:49:21 user nova-compute[76161]:   </devices>
Nov 14 17:49:21 user nova-compute[76161]: </domain>
Nov 14 17:49:21 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2089056756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2089056756',id=1,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-cfswyfga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:13Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=bed4f7a2-be4f-4c3a-a925-4c8b65105fb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=f023f734-0b61-461c-b3ab-100bcf5706b6,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023f734-0b') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG os_vif [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=f023f734-0b61-461c-b3ab-100bcf5706b6,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023f734-0b') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Successfully updated port: 1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Created schema index Interface.name {{(pid=76161) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Created schema index Port.name {{(pid=76161) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Created schema index Bridge.name {{(pid=76161) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [POLLOUT] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "refresh_cache-f8c62b07-2d5b-4619-98ec-b77eb524829a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquired lock "refresh_cache-f8c62b07-2d5b-4619-98ec-b77eb524829a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-3f12b2e4-09e4-478f-b45c-2a78bd5efa48 req-bd2216fe-dcb7-4300-91a2-410a26c4bae4 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-changed-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-3f12b2e4-09e4-478f-b45c-2a78bd5efa48 req-bd2216fe-dcb7-4300-91a2-410a26c4bae4 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Refreshing instance network info cache due to event network-changed-670ed619-c20d-45af-a7c8-dc9d1d3172f9. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f12b2e4-09e4-478f-b45c-2a78bd5efa48 req-bd2216fe-dcb7-4300-91a2-410a26c4bae4 service nova] Acquiring lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Cannot resize image /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Ensure instance console log exists: /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed1a48af-d17c-559d-a9da-4ff98f57182c', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:21 user nova-compute[76161]: INFO oslo.privsep.daemon [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpp16m7knb/privsep.sock']
Nov 14 17:49:21 user sudo[85515]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpp16m7knb/privsep.sock
Nov 14 17:49:21 user sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 17:49:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:49:22 user nova-compute[76161]: DEBUG nova.network.neutron [req-011f8099-9b4f-4b9c-83ea-8531a0f64a2d req-862c3350-39e4-40df-93fb-2069426c9b69 service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Updated VIF entry in instance network info cache for port f023f734-0b61-461c-b3ab-100bcf5706b6. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:49:22 user nova-compute[76161]: DEBUG nova.network.neutron [req-011f8099-9b4f-4b9c-83ea-8531a0f64a2d req-862c3350-39e4-40df-93fb-2069426c9b69 service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Updating instance_info_cache with network_info: [{"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-011f8099-9b4f-4b9c-83ea-8531a0f64a2d req-862c3350-39e4-40df-93fb-2069426c9b69 service nova] Releasing lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Successfully created port: 39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:49:23 user sudo[85515]: pam_unix(sudo:session): session closed for user root
Nov 14 17:49:23 user nova-compute[76161]: INFO oslo.privsep.daemon [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Spawned new privsep daemon via rootwrap
Nov 14 17:49:23 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 17:49:23 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 17:49:23 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 17:49:23 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85523
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Updating instance_info_cache with network_info: [{"id": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "address": "fa:16:3e:df:b5:49", "network": {"id": "61d20bac-ea5b-4701-87b6-2a93034b65df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1734807919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d92618d87174e86a36acfb7d069a698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb2ea53-e6", "ovs_interfaceid": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Releasing lock "refresh_cache-f8c62b07-2d5b-4619-98ec-b77eb524829a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Instance network_info: |[{"id": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "address": "fa:16:3e:df:b5:49", "network": {"id": "61d20bac-ea5b-4701-87b6-2a93034b65df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1734807919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d92618d87174e86a36acfb7d069a698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb2ea53-e6", "ovs_interfaceid": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Start _get_guest_xml network_info=[{"id": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "address": "fa:16:3e:df:b5:49", "network": {"id": "61d20bac-ea5b-4701-87b6-2a93034b65df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1734807919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d92618d87174e86a36acfb7d069a698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb2ea53-e6", "ovs_interfaceid": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:49:23 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:23 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2001480072',display_name='tempest-DeleteServersTestJSON-server-2001480072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2001480072',id=3,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d92618d87174e86a36acfb7d069a698',ramdisk_id='',reservation_id='r-j4v6eqdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-328001957',owner_user_name='tempest-DeleteServersTestJSON-328001957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:17Z,user_data=None,user_id='0f5c7bf573614b7dbed7484623bbdddf',uuid=f8c62b07-2d5b-4619-98ec-b77eb524829a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "address": "fa:16:3e:df:b5:49", "network": {"id": "61d20bac-ea5b-4701-87b6-2a93034b65df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1734807919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d92618d87174e86a36acfb7d069a698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb2ea53-e6", "ovs_interfaceid": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Converting VIF {"id": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "address": "fa:16:3e:df:b5:49", "network": {"id": "61d20bac-ea5b-4701-87b6-2a93034b65df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1734807919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d92618d87174e86a36acfb7d069a698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb2ea53-e6", "ovs_interfaceid": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:b5:49,bridge_name='br-int',has_traffic_filtering=True,id=1bb2ea53-e638-4012-9fa0-f2ca60290348,network=Network(61d20bac-ea5b-4701-87b6-2a93034b65df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb2ea53-e6') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lazy-loading 'pci_devices' on Instance uuid f8c62b07-2d5b-4619-98ec-b77eb524829a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Updating instance_info_cache with network_info: [{"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:49:23 user nova-compute[76161]:   <uuid>f8c62b07-2d5b-4619-98ec-b77eb524829a</uuid>
Nov 14 17:49:23 user nova-compute[76161]:   <name>instance-00000003</name>
Nov 14 17:49:23 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:49:23 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:49:23 user nova-compute[76161]:   <metadata>
Nov 14 17:49:23 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:49:23 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:name>tempest-DeleteServersTestJSON-server-2001480072</nova:name>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:49:23</nova:creationTime>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:49:23 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:49:23 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:owner>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:user uuid="0f5c7bf573614b7dbed7484623bbdddf">tempest-DeleteServersTestJSON-328001957-project-member</nova:user>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:project uuid="1d92618d87174e86a36acfb7d069a698">tempest-DeleteServersTestJSON-328001957</nova:project>
Nov 14 17:49:23 user nova-compute[76161]:       </nova:owner>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:ports>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:port uuid="1bb2ea53-e638-4012-9fa0-f2ca60290348">
Nov 14 17:49:23 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:49:23 user nova-compute[76161]:         </nova:port>
Nov 14 17:49:23 user nova-compute[76161]:       </nova:ports>
Nov 14 17:49:23 user nova-compute[76161]:     </nova:instance>
Nov 14 17:49:23 user nova-compute[76161]:   </metadata>
Nov 14 17:49:23 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:49:23 user nova-compute[76161]:     <system>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="serial">f8c62b07-2d5b-4619-98ec-b77eb524829a</entry>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="uuid">f8c62b07-2d5b-4619-98ec-b77eb524829a</entry>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:49:23 user nova-compute[76161]:     </system>
Nov 14 17:49:23 user nova-compute[76161]:   </sysinfo>
Nov 14 17:49:23 user nova-compute[76161]:   <os>
Nov 14 17:49:23 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:49:23 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:49:23 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:49:23 user nova-compute[76161]:   </os>
Nov 14 17:49:23 user nova-compute[76161]:   <features>
Nov 14 17:49:23 user nova-compute[76161]:     <acpi/>
Nov 14 17:49:23 user nova-compute[76161]:     <apic/>
Nov 14 17:49:23 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:49:23 user nova-compute[76161]:   </features>
Nov 14 17:49:23 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:49:23 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:49:23 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:49:23 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:49:23 user nova-compute[76161]:   </clock>
Nov 14 17:49:23 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:49:23 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:49:23 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:49:23 user nova-compute[76161]:   </cpu>
Nov 14 17:49:23 user nova-compute[76161]:   <devices>
Nov 14 17:49:23 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:49:23 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:49:23 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk"/>
Nov 14 17:49:23 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:49:23 user nova-compute[76161]:     </disk>
Nov 14 17:49:23 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:49:23 user nova-compute[76161]:       <mac address="fa:16:3e:df:b5:49"/>
Nov 14 17:49:23 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:23 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:49:23 user nova-compute[76161]:       <target dev="tap1bb2ea53-e6"/>
Nov 14 17:49:23 user nova-compute[76161]:     </interface>
Nov 14 17:49:23 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:49:23 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/console.log" append="off"/>
Nov 14 17:49:23 user nova-compute[76161]:     </serial>
Nov 14 17:49:23 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:49:23 user nova-compute[76161]:     <video>
Nov 14 17:49:23 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:23 user nova-compute[76161]:     </video>
Nov 14 17:49:23 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:49:23 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:49:23 user nova-compute[76161]:     </rng>
Nov 14 17:49:23 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:49:23 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:49:23 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:49:23 user nova-compute[76161]:     </memballoon>
Nov 14 17:49:23 user nova-compute[76161]:   </devices>
Nov 14 17:49:23 user nova-compute[76161]: </domain>
Nov 14 17:49:23 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2001480072',display_name='tempest-DeleteServersTestJSON-server-2001480072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2001480072',id=3,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d92618d87174e86a36acfb7d069a698',ramdisk_id='',reservation_id='r-j4v6eqdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-328001957',owner_user_name='tempest-DeleteServersTestJSON-328001957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:17Z,user_data=None,user_id='0f5c7bf573614b7dbed7484623bbdddf',uuid=f8c62b07-2d5b-4619-98ec-b77eb524829a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "address": "fa:16:3e:df:b5:49", "network": {"id": "61d20bac-ea5b-4701-87b6-2a93034b65df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1734807919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d92618d87174e86a36acfb7d069a698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb2ea53-e6", "ovs_interfaceid": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Converting VIF {"id": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "address": "fa:16:3e:df:b5:49", "network": {"id": "61d20bac-ea5b-4701-87b6-2a93034b65df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1734807919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d92618d87174e86a36acfb7d069a698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb2ea53-e6", "ovs_interfaceid": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:b5:49,bridge_name='br-int',has_traffic_filtering=True,id=1bb2ea53-e638-4012-9fa0-f2ca60290348,network=Network(61d20bac-ea5b-4701-87b6-2a93034b65df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb2ea53-e6') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG os_vif [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:b5:49,bridge_name='br-int',has_traffic_filtering=True,id=1bb2ea53-e638-4012-9fa0-f2ca60290348,network=Network(61d20bac-ea5b-4701-87b6-2a93034b65df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb2ea53-e6') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Releasing lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Instance network_info: |[{"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a80099d-c48d-509a-b5d6-489c4abf1dc0', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f12b2e4-09e4-478f-b45c-2a78bd5efa48 req-bd2216fe-dcb7-4300-91a2-410a26c4bae4 service nova] Acquired lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-3f12b2e4-09e4-478f-b45c-2a78bd5efa48 req-bd2216fe-dcb7-4300-91a2-410a26c4bae4 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Refreshing network info cache for port 670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Start _get_guest_xml network_info=[{"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:23 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:23 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1145779311',display_name='tempest-ServersNegativeTestJSON-server-1145779311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1145779311',id=2,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68afcd8a90ba42bd860204d31efae7e0',ramdisk_id='',reservation_id='r-t70n8d88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1371271005',owner_user_name='tempest-ServersNegativeTestJSON-1371271005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:16Z,user_data=None,user_id='983ee707e2eb4a2ba4617f91d810011d',uuid=a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converting VIF {"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:2b:cf,bridge_name='br-int',has_traffic_filtering=True,id=670ed619-c20d-45af-a7c8-dc9d1d3172f9,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670ed619-c2') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.objects.instance [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lazy-loading 'pci_devices' on Instance uuid a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:49:23 user nova-compute[76161]:   <uuid>a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d</uuid>
Nov 14 17:49:23 user nova-compute[76161]:   <name>instance-00000002</name>
Nov 14 17:49:23 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:49:23 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:49:23 user nova-compute[76161]:   <metadata>
Nov 14 17:49:23 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:49:23 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:name>tempest-ServersNegativeTestJSON-server-1145779311</nova:name>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:49:23</nova:creationTime>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:49:23 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:49:23 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:owner>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:user uuid="983ee707e2eb4a2ba4617f91d810011d">tempest-ServersNegativeTestJSON-1371271005-project-member</nova:user>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:project uuid="68afcd8a90ba42bd860204d31efae7e0">tempest-ServersNegativeTestJSON-1371271005</nova:project>
Nov 14 17:49:23 user nova-compute[76161]:       </nova:owner>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:49:23 user nova-compute[76161]:       <nova:ports>
Nov 14 17:49:23 user nova-compute[76161]:         <nova:port uuid="670ed619-c20d-45af-a7c8-dc9d1d3172f9">
Nov 14 17:49:23 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:49:23 user nova-compute[76161]:         </nova:port>
Nov 14 17:49:23 user nova-compute[76161]:       </nova:ports>
Nov 14 17:49:23 user nova-compute[76161]:     </nova:instance>
Nov 14 17:49:23 user nova-compute[76161]:   </metadata>
Nov 14 17:49:23 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:49:23 user nova-compute[76161]:     <system>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="serial">a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d</entry>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="uuid">a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d</entry>
Nov 14 17:49:23 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:49:23 user nova-compute[76161]:     </system>
Nov 14 17:49:23 user nova-compute[76161]:   </sysinfo>
Nov 14 17:49:23 user nova-compute[76161]:   <os>
Nov 14 17:49:23 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:49:23 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:49:23 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:49:23 user nova-compute[76161]:   </os>
Nov 14 17:49:23 user nova-compute[76161]:   <features>
Nov 14 17:49:23 user nova-compute[76161]:     <acpi/>
Nov 14 17:49:23 user nova-compute[76161]:     <apic/>
Nov 14 17:49:23 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:49:23 user nova-compute[76161]:   </features>
Nov 14 17:49:23 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:49:23 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:49:23 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:49:23 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:49:23 user nova-compute[76161]:   </clock>
Nov 14 17:49:23 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:49:23 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:49:23 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:49:23 user nova-compute[76161]:   </cpu>
Nov 14 17:49:23 user nova-compute[76161]:   <devices>
Nov 14 17:49:23 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:49:23 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:49:23 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk"/>
Nov 14 17:49:23 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:49:23 user nova-compute[76161]:     </disk>
Nov 14 17:49:23 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:49:23 user nova-compute[76161]:       <mac address="fa:16:3e:89:2b:cf"/>
Nov 14 17:49:23 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:23 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:49:23 user nova-compute[76161]:       <target dev="tap670ed619-c2"/>
Nov 14 17:49:23 user nova-compute[76161]:     </interface>
Nov 14 17:49:23 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:49:23 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/console.log" append="off"/>
Nov 14 17:49:23 user nova-compute[76161]:     </serial>
Nov 14 17:49:23 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:49:23 user nova-compute[76161]:     <video>
Nov 14 17:49:23 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:23 user nova-compute[76161]:     </video>
Nov 14 17:49:23 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:49:23 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:49:23 user nova-compute[76161]:     </rng>
Nov 14 17:49:23 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:49:23 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:49:23 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:49:23 user nova-compute[76161]:     </memballoon>
Nov 14 17:49:23 user nova-compute[76161]:   </devices>
Nov 14 17:49:23 user nova-compute[76161]: </domain>
Nov 14 17:49:23 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1145779311',display_name='tempest-ServersNegativeTestJSON-server-1145779311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1145779311',id=2,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68afcd8a90ba42bd860204d31efae7e0',ramdisk_id='',reservation_id='r-t70n8d88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1371271005',owner_user_name='tempest-ServersNegativeTestJSON-1371271005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:16Z,user_data=None,user_id='983ee707e2eb4a2ba4617f91d810011d',uuid=a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converting VIF {"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:2b:cf,bridge_name='br-int',has_traffic_filtering=True,id=670ed619-c20d-45af-a7c8-dc9d1d3172f9,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670ed619-c2') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG os_vif [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:2b:cf,bridge_name='br-int',has_traffic_filtering=True,id=670ed619-c20d-45af-a7c8-dc9d1d3172f9,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670ed619-c2') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f384d77c-d6a0-552c-83ae-964a827761c5', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf023f734-0b, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf023f734-0b, col_values=(('qos', UUID('7f1d8e3e-d7cd-4427-b874-c82dd1391dca')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf023f734-0b, col_values=(('external_ids', {'iface-id': 'f023f734-0b61-461c-b3ab-100bcf5706b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:e1:31', 'vm-uuid': 'bed4f7a2-be4f-4c3a-a925-4c8b65105fb0'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bb2ea53-e6, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bb2ea53-e6, col_values=(('qos', UUID('e3a7a70d-2182-4fad-8b32-53793e457adc')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bb2ea53-e6, col_values=(('external_ids', {'iface-id': '1bb2ea53-e638-4012-9fa0-f2ca60290348', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:b5:49', 'vm-uuid': 'f8c62b07-2d5b-4619-98ec-b77eb524829a'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: INFO os_vif [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=f023f734-0b61-461c-b3ab-100bcf5706b6,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023f734-0b')
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: INFO os_vif [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:b5:49,bridge_name='br-int',has_traffic_filtering=True,id=1bb2ea53-e638-4012-9fa0-f2ca60290348,network=Network(61d20bac-ea5b-4701-87b6-2a93034b65df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb2ea53-e6')
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap670ed619-c2, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap670ed619-c2, col_values=(('qos', UUID('38b4a0b4-df1d-4620-a6ea-e8bb72e9e7e5')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap670ed619-c2, col_values=(('external_ids', {'iface-id': '670ed619-c20d-45af-a7c8-dc9d1d3172f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:2b:cf', 'vm-uuid': 'a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:23 user nova-compute[76161]: INFO os_vif [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:2b:cf,bridge_name='br-int',has_traffic_filtering=True,id=670ed619-c20d-45af-a7c8-dc9d1d3172f9,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670ed619-c2')
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No VIF found with MAC fa:16:3e:f4:e1:31, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] No VIF found with MAC fa:16:3e:df:b5:49, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] No VIF found with MAC fa:16:3e:89:2b:cf, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-5343cff3-9194-4794-b145-c71c30346af5 req-357e2837-c70d-4b68-a26b-add793ad0609 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Received event network-changed-1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-5343cff3-9194-4794-b145-c71c30346af5 req-357e2837-c70d-4b68-a26b-add793ad0609 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Refreshing instance network info cache due to event network-changed-1bb2ea53-e638-4012-9fa0-f2ca60290348. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5343cff3-9194-4794-b145-c71c30346af5 req-357e2837-c70d-4b68-a26b-add793ad0609 service nova] Acquiring lock "refresh_cache-f8c62b07-2d5b-4619-98ec-b77eb524829a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5343cff3-9194-4794-b145-c71c30346af5 req-357e2837-c70d-4b68-a26b-add793ad0609 service nova] Acquired lock "refresh_cache-f8c62b07-2d5b-4619-98ec-b77eb524829a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-5343cff3-9194-4794-b145-c71c30346af5 req-357e2837-c70d-4b68-a26b-add793ad0609 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Refreshing network info cache for port 1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "1040ce71-437b-4398-9bb5-bd34e86589a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:49:24 user nova-compute[76161]: INFO nova.compute.claims [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Claim successful on node user
Nov 14 17:49:24 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Successfully updated port: 39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG nova.network.neutron [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquired lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:24 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:49:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:49:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:49:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Creating image(s)
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "/opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "/opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "/opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.neutron [req-3f12b2e4-09e4-478f-b45c-2a78bd5efa48 req-bd2216fe-dcb7-4300-91a2-410a26c4bae4 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Updated VIF entry in instance network info cache for port 670ed619-c20d-45af-a7c8-dc9d1d3172f9. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.neutron [req-3f12b2e4-09e4-478f-b45c-2a78bd5efa48 req-bd2216fe-dcb7-4300-91a2-410a26c4bae4 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Updating instance_info_cache with network_info: [{"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f12b2e4-09e4-478f-b45c-2a78bd5efa48 req-bd2216fe-dcb7-4300-91a2-410a26c4bae4 service nova] Releasing lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.policy [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbfeb35beb394e15bf881780f69724f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4467aca672a34c1a8f4e1735636d311b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.225s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-f2dc55f7-6fb8-40ff-8256-602d938d513f req-57fa4bbb-3220-413c-ac42-ac2de044e9d2 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-changed-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-f2dc55f7-6fb8-40ff-8256-602d938d513f req-57fa4bbb-3220-413c-ac42-ac2de044e9d2 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Refreshing instance network info cache due to event network-changed-39b86458-3c6f-457f-b2ba-e2f4709ffb50. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f2dc55f7-6fb8-40ff-8256-602d938d513f req-57fa4bbb-3220-413c-ac42-ac2de044e9d2 service nova] Acquiring lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating instance_info_cache with network_info: [{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Releasing lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance network_info: |[{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f2dc55f7-6fb8-40ff-8256-602d938d513f req-57fa4bbb-3220-413c-ac42-ac2de044e9d2 service nova] Acquired lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.neutron [req-f2dc55f7-6fb8-40ff-8256-602d938d513f req-57fa4bbb-3220-413c-ac42-ac2de044e9d2 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Refreshing network info cache for port 39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Start _get_guest_xml network_info=[{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:49:25 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:25 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.neutron [req-5343cff3-9194-4794-b145-c71c30346af5 req-357e2837-c70d-4b68-a26b-add793ad0609 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Updated VIF entry in instance network info cache for port 1bb2ea53-e638-4012-9fa0-f2ca60290348. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.neutron [req-5343cff3-9194-4794-b145-c71c30346af5 req-357e2837-c70d-4b68-a26b-add793ad0609 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Updating instance_info_cache with network_info: [{"id": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "address": "fa:16:3e:df:b5:49", "network": {"id": "61d20bac-ea5b-4701-87b6-2a93034b65df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1734807919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d92618d87174e86a36acfb7d069a698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb2ea53-e6", "ovs_interfaceid": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-412733385',display_name='tempest-ServerActionsTestOtherB-server-412733385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-412733385',id=4,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0NZD4kqQvyUmQDlStvq04ezcWsfIyD0A/bWacUhJpYz5fcS1f2SC6UBuTPRJ8HEnEXX6nzxYwzXvCIrkT+ksrUBvLI5jLRbrB40MHHEGW3qMOyOEwSYMvxHD0HaK5eqA==',key_name='tempest-keypair-1585564500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d05c015b22d142de91f43f92f00fe8f5',ramdisk_id='',reservation_id='r-ixxlkxwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2076940630',owner_user_name='tempest-ServerActionsTestOtherB-2076940630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdcf024ba5d2481aad966acad37d9275',uuid=56f47238-81fe-4196-865c-e1ad68cf6fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converting VIF {"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lazy-loading 'pci_devices' on Instance uuid 56f47238-81fe-4196-865c-e1ad68cf6fea {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5343cff3-9194-4794-b145-c71c30346af5 req-357e2837-c70d-4b68-a26b-add793ad0609 service nova] Releasing lock "refresh_cache-f8c62b07-2d5b-4619-98ec-b77eb524829a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:49:25 user nova-compute[76161]:   <uuid>56f47238-81fe-4196-865c-e1ad68cf6fea</uuid>
Nov 14 17:49:25 user nova-compute[76161]:   <name>instance-00000004</name>
Nov 14 17:49:25 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:49:25 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:49:25 user nova-compute[76161]:   <metadata>
Nov 14 17:49:25 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:49:25 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:49:25 user nova-compute[76161]:       <nova:name>tempest-ServerActionsTestOtherB-server-412733385</nova:name>
Nov 14 17:49:25 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:49:25</nova:creationTime>
Nov 14 17:49:25 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:49:25 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:49:25 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:49:25 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:49:25 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:49:25 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:49:25 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:49:25 user nova-compute[76161]:       <nova:owner>
Nov 14 17:49:25 user nova-compute[76161]:         <nova:user uuid="fdcf024ba5d2481aad966acad37d9275">tempest-ServerActionsTestOtherB-2076940630-project-member</nova:user>
Nov 14 17:49:25 user nova-compute[76161]:         <nova:project uuid="d05c015b22d142de91f43f92f00fe8f5">tempest-ServerActionsTestOtherB-2076940630</nova:project>
Nov 14 17:49:25 user nova-compute[76161]:       </nova:owner>
Nov 14 17:49:25 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:49:25 user nova-compute[76161]:       <nova:ports>
Nov 14 17:49:25 user nova-compute[76161]:         <nova:port uuid="39b86458-3c6f-457f-b2ba-e2f4709ffb50">
Nov 14 17:49:25 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 17:49:25 user nova-compute[76161]:         </nova:port>
Nov 14 17:49:25 user nova-compute[76161]:       </nova:ports>
Nov 14 17:49:25 user nova-compute[76161]:     </nova:instance>
Nov 14 17:49:25 user nova-compute[76161]:   </metadata>
Nov 14 17:49:25 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:49:25 user nova-compute[76161]:     <system>
Nov 14 17:49:25 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:49:25 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:49:25 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:49:25 user nova-compute[76161]:       <entry name="serial">56f47238-81fe-4196-865c-e1ad68cf6fea</entry>
Nov 14 17:49:25 user nova-compute[76161]:       <entry name="uuid">56f47238-81fe-4196-865c-e1ad68cf6fea</entry>
Nov 14 17:49:25 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:49:25 user nova-compute[76161]:     </system>
Nov 14 17:49:25 user nova-compute[76161]:   </sysinfo>
Nov 14 17:49:25 user nova-compute[76161]:   <os>
Nov 14 17:49:25 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:49:25 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:49:25 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:49:25 user nova-compute[76161]:   </os>
Nov 14 17:49:25 user nova-compute[76161]:   <features>
Nov 14 17:49:25 user nova-compute[76161]:     <acpi/>
Nov 14 17:49:25 user nova-compute[76161]:     <apic/>
Nov 14 17:49:25 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:49:25 user nova-compute[76161]:   </features>
Nov 14 17:49:25 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:49:25 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:49:25 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:49:25 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:49:25 user nova-compute[76161]:   </clock>
Nov 14 17:49:25 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:49:25 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:49:25 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:49:25 user nova-compute[76161]:   </cpu>
Nov 14 17:49:25 user nova-compute[76161]:   <devices>
Nov 14 17:49:25 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:49:25 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:49:25 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk"/>
Nov 14 17:49:25 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:49:25 user nova-compute[76161]:     </disk>
Nov 14 17:49:25 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:49:25 user nova-compute[76161]:       <mac address="fa:16:3e:27:c8:17"/>
Nov 14 17:49:25 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:25 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:49:25 user nova-compute[76161]:       <target dev="tap39b86458-3c"/>
Nov 14 17:49:25 user nova-compute[76161]:     </interface>
Nov 14 17:49:25 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:49:25 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/console.log" append="off"/>
Nov 14 17:49:25 user nova-compute[76161]:     </serial>
Nov 14 17:49:25 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:49:25 user nova-compute[76161]:     <video>
Nov 14 17:49:25 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:25 user nova-compute[76161]:     </video>
Nov 14 17:49:25 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:49:25 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:49:25 user nova-compute[76161]:     </rng>
Nov 14 17:49:25 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:49:25 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:49:25 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:49:25 user nova-compute[76161]:     </memballoon>
Nov 14 17:49:25 user nova-compute[76161]:   </devices>
Nov 14 17:49:25 user nova-compute[76161]: </domain>
Nov 14 17:49:25 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-412733385',display_name='tempest-ServerActionsTestOtherB-server-412733385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-412733385',id=4,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0NZD4kqQvyUmQDlStvq04ezcWsfIyD0A/bWacUhJpYz5fcS1f2SC6UBuTPRJ8HEnEXX6nzxYwzXvCIrkT+ksrUBvLI5jLRbrB40MHHEGW3qMOyOEwSYMvxHD0HaK5eqA==',key_name='tempest-keypair-1585564500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d05c015b22d142de91f43f92f00fe8f5',ramdisk_id='',reservation_id='r-ixxlkxwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2076940630',owner_user_name='tempest-ServerActionsTestOtherB-2076940630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdcf024ba5d2481aad966acad37d9275',uuid=56f47238-81fe-4196-865c-e1ad68cf6fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converting VIF {"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG os_vif [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82001577-839c-52ad-839d-3a9eb403b664', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk 1073741824" returned: 0 in 0.065s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39b86458-3c, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39b86458-3c, col_values=(('qos', UUID('82515976-a8c8-4ddd-a0e6-29f94d71ba34')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39b86458-3c, col_values=(('external_ids', {'iface-id': '39b86458-3c6f-457f-b2ba-e2f4709ffb50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:c8:17', 'vm-uuid': '56f47238-81fe-4196-865c-e1ad68cf6fea'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:25 user nova-compute[76161]: INFO os_vif [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c')
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] No VIF found with MAC fa:16:3e:27:c8:17, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Cannot resize image /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Ensure instance console log exists: /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-f2dc55f7-6fb8-40ff-8256-602d938d513f req-57fa4bbb-3220-413c-ac42-ac2de044e9d2 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updated VIF entry in instance network info cache for port 39b86458-3c6f-457f-b2ba-e2f4709ffb50. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:49:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-f2dc55f7-6fb8-40ff-8256-602d938d513f req-57fa4bbb-3220-413c-ac42-ac2de044e9d2 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating instance_info_cache with network_info: [{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f2dc55f7-6fb8-40ff-8256-602d938d513f req-57fa4bbb-3220-413c-ac42-ac2de044e9d2 service nova] Releasing lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Successfully created port: f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:49:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG nova.network.neutron [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Successfully updated port: f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquired lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG nova.network.neutron [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-222cc5c7-9509-400b-ad60-d5ce721236a2 req-43dd4436-106d-4fe0-9fff-e8324a01ed66 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received event network-changed-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-222cc5c7-9509-400b-ad60-d5ce721236a2 req-43dd4436-106d-4fe0-9fff-e8324a01ed66 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Refreshing instance network info cache due to event network-changed-f8e82122-b7bf-4a06-b5cc-084e959e2e11. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-222cc5c7-9509-400b-ad60-d5ce721236a2 req-43dd4436-106d-4fe0-9fff-e8324a01ed66 service nova] Acquiring lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG nova.network.neutron [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.network.neutron [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updating instance_info_cache with network_info: [{"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Releasing lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Instance network_info: |[{"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-222cc5c7-9509-400b-ad60-d5ce721236a2 req-43dd4436-106d-4fe0-9fff-e8324a01ed66 service nova] Acquired lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.network.neutron [req-222cc5c7-9509-400b-ad60-d5ce721236a2 req-43dd4436-106d-4fe0-9fff-e8324a01ed66 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Refreshing network info cache for port f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Start _get_guest_xml network_info=[{"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:49:30 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:30 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-777168735',display_name='tempest-ServerActionsTestOtherA-server-777168735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-777168735',id=5,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/qLMrSixUeoWRNqyyMAmkr6Jdv4puUPBA23tnedByCcFoj2iOZE+ZPEXsuKk/6jLGW1AaCT9PLvxK/WjfaizeZDXI/isTmP1fIOMxcZKPA16ZEa+3fb0iod0Nl+OKmuw==',key_name='tempest-keypair-197899952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-hl5mowhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=1040ce71-437b-4398-9bb5-bd34e86589a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:71:11,bridge_name='br-int',has_traffic_filtering=True,id=f8e82122-b7bf-4a06-b5cc-084e959e2e11,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e82122-b7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.objects.instance [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'pci_devices' on Instance uuid 1040ce71-437b-4398-9bb5-bd34e86589a7 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:49:30 user nova-compute[76161]:   <uuid>1040ce71-437b-4398-9bb5-bd34e86589a7</uuid>
Nov 14 17:49:30 user nova-compute[76161]:   <name>instance-00000005</name>
Nov 14 17:49:30 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:49:30 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:49:30 user nova-compute[76161]:   <metadata>
Nov 14 17:49:30 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:49:30 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:49:30 user nova-compute[76161]:       <nova:name>tempest-ServerActionsTestOtherA-server-777168735</nova:name>
Nov 14 17:49:30 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:49:30</nova:creationTime>
Nov 14 17:49:30 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:49:30 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:49:30 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:49:30 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:49:30 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:49:30 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:49:30 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:49:30 user nova-compute[76161]:       <nova:owner>
Nov 14 17:49:30 user nova-compute[76161]:         <nova:user uuid="bbfeb35beb394e15bf881780f69724f6">tempest-ServerActionsTestOtherA-233736107-project-member</nova:user>
Nov 14 17:49:30 user nova-compute[76161]:         <nova:project uuid="4467aca672a34c1a8f4e1735636d311b">tempest-ServerActionsTestOtherA-233736107</nova:project>
Nov 14 17:49:30 user nova-compute[76161]:       </nova:owner>
Nov 14 17:49:30 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:49:30 user nova-compute[76161]:       <nova:ports>
Nov 14 17:49:30 user nova-compute[76161]:         <nova:port uuid="f8e82122-b7bf-4a06-b5cc-084e959e2e11">
Nov 14 17:49:30 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:49:30 user nova-compute[76161]:         </nova:port>
Nov 14 17:49:30 user nova-compute[76161]:       </nova:ports>
Nov 14 17:49:30 user nova-compute[76161]:     </nova:instance>
Nov 14 17:49:30 user nova-compute[76161]:   </metadata>
Nov 14 17:49:30 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:49:30 user nova-compute[76161]:     <system>
Nov 14 17:49:30 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:49:30 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:49:30 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:49:30 user nova-compute[76161]:       <entry name="serial">1040ce71-437b-4398-9bb5-bd34e86589a7</entry>
Nov 14 17:49:30 user nova-compute[76161]:       <entry name="uuid">1040ce71-437b-4398-9bb5-bd34e86589a7</entry>
Nov 14 17:49:30 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:49:30 user nova-compute[76161]:     </system>
Nov 14 17:49:30 user nova-compute[76161]:   </sysinfo>
Nov 14 17:49:30 user nova-compute[76161]:   <os>
Nov 14 17:49:30 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:49:30 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:49:30 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:49:30 user nova-compute[76161]:   </os>
Nov 14 17:49:30 user nova-compute[76161]:   <features>
Nov 14 17:49:30 user nova-compute[76161]:     <acpi/>
Nov 14 17:49:30 user nova-compute[76161]:     <apic/>
Nov 14 17:49:30 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:49:30 user nova-compute[76161]:   </features>
Nov 14 17:49:30 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:49:30 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:49:30 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:49:30 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:49:30 user nova-compute[76161]:   </clock>
Nov 14 17:49:30 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:49:30 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:49:30 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:49:30 user nova-compute[76161]:   </cpu>
Nov 14 17:49:30 user nova-compute[76161]:   <devices>
Nov 14 17:49:30 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:49:30 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:49:30 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk"/>
Nov 14 17:49:30 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:49:30 user nova-compute[76161]:     </disk>
Nov 14 17:49:30 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:49:30 user nova-compute[76161]:       <mac address="fa:16:3e:7a:71:11"/>
Nov 14 17:49:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:30 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:49:30 user nova-compute[76161]:       <target dev="tapf8e82122-b7"/>
Nov 14 17:49:30 user nova-compute[76161]:     </interface>
Nov 14 17:49:30 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:49:30 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/console.log" append="off"/>
Nov 14 17:49:30 user nova-compute[76161]:     </serial>
Nov 14 17:49:30 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:49:30 user nova-compute[76161]:     <video>
Nov 14 17:49:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:30 user nova-compute[76161]:     </video>
Nov 14 17:49:30 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:49:30 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:49:30 user nova-compute[76161]:     </rng>
Nov 14 17:49:30 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:49:30 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:49:30 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:49:30 user nova-compute[76161]:     </memballoon>
Nov 14 17:49:30 user nova-compute[76161]:   </devices>
Nov 14 17:49:30 user nova-compute[76161]: </domain>
Nov 14 17:49:30 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-777168735',display_name='tempest-ServerActionsTestOtherA-server-777168735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-777168735',id=5,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/qLMrSixUeoWRNqyyMAmkr6Jdv4puUPBA23tnedByCcFoj2iOZE+ZPEXsuKk/6jLGW1AaCT9PLvxK/WjfaizeZDXI/isTmP1fIOMxcZKPA16ZEa+3fb0iod0Nl+OKmuw==',key_name='tempest-keypair-197899952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-hl5mowhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=1040ce71-437b-4398-9bb5-bd34e86589a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:71:11,bridge_name='br-int',has_traffic_filtering=True,id=f8e82122-b7bf-4a06-b5cc-084e959e2e11,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e82122-b7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG os_vif [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:71:11,bridge_name='br-int',has_traffic_filtering=True,id=f8e82122-b7bf-4a06-b5cc-084e959e2e11,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e82122-b7') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da79cbc3-acc4-5776-9087-b66d50fdaaa9', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8e82122-b7, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8e82122-b7, col_values=(('qos', UUID('2ac2c3a7-c3c3-474f-81ea-6bcb9468ed03')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8e82122-b7, col_values=(('external_ids', {'iface-id': 'f8e82122-b7bf-4a06-b5cc-084e959e2e11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:71:11', 'vm-uuid': '1040ce71-437b-4398-9bb5-bd34e86589a7'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:30 user nova-compute[76161]: INFO os_vif [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:71:11,bridge_name='br-int',has_traffic_filtering=True,id=f8e82122-b7bf-4a06-b5cc-084e959e2e11,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e82122-b7')
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No VIF found with MAC fa:16:3e:7a:71:11, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.network.neutron [req-222cc5c7-9509-400b-ad60-d5ce721236a2 req-43dd4436-106d-4fe0-9fff-e8324a01ed66 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updated VIF entry in instance network info cache for port f8e82122-b7bf-4a06-b5cc-084e959e2e11. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG nova.network.neutron [req-222cc5c7-9509-400b-ad60-d5ce721236a2 req-43dd4436-106d-4fe0-9fff-e8324a01ed66 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updating instance_info_cache with network_info: [{"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-222cc5c7-9509-400b-ad60-d5ce721236a2 req-43dd4436-106d-4fe0-9fff-e8324a01ed66 service nova] Releasing lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "678e458a-aeb6-4f29-b20b-74115179025f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:49:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:49:32 user nova-compute[76161]: INFO nova.compute.claims [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Claim successful on node user
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:49:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Instance spawned successfully.
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:49:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Instance spawned successfully.
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:49:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance spawned successfully.
Nov 14 17:49:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:49:33 user nova-compute[76161]: INFO nova.compute.manager [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Took 19.74 seconds to spawn the instance on the hypervisor.
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: INFO nova.compute.manager [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Took 16.29 seconds to spawn the instance on the hypervisor.
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:49:33 user nova-compute[76161]: INFO nova.compute.manager [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Took 12.32 seconds to spawn the instance on the hypervisor.
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:49:33 user nova-compute[76161]: INFO nova.compute.manager [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Took 20.79 seconds to build instance.
Nov 14 17:49:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cb808446-ae1d-429f-9ca0-d44a367b5e09 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.978s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:33 user nova-compute[76161]: INFO nova.compute.manager [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Took 17.66 seconds to build instance.
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2c08ac93-a73d-4305-84c8-f98325c16f77 tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.819s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:33 user nova-compute[76161]: INFO nova.compute.manager [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Took 13.21 seconds to build instance.
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a6d6fc2-14aa-466c-a00d-705ddac8d832 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.367s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:33 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Instance spawned successfully.
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.156s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.network.neutron [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:49:33 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:49:33 user nova-compute[76161]: INFO nova.compute.manager [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Took 17.20 seconds to spawn the instance on the hypervisor.
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:49:33 user nova-compute[76161]: INFO nova.compute.manager [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Took 18.22 seconds to build instance.
Nov 14 17:49:33 user nova-compute[76161]: DEBUG nova.policy [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce9768ac5fdb4774874128973d9e7b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734a545ba17409c812203610ba23ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9a70eae-4e56-4bc5-86d0-b6a0a6d10979 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.631s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:49:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Creating image(s)
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "/opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "/opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "/opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.252s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.234s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:49:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Instance spawned successfully.
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk 1073741824" returned: 0 in 0.115s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:34 user nova-compute[76161]: INFO nova.compute.manager [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Took 9.86 seconds to spawn the instance on the hypervisor.
Nov 14 17:49:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.237s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Checking if we can resize image /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:35 user nova-compute[76161]: INFO nova.compute.manager [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Took 10.93 seconds to build instance.
Nov 14 17:49:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93814290-cbd4-452c-adce-7c5cdd946b66 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.154s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.419s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Cannot resize image /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Ensure instance console log exists: /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:35 user nova-compute[76161]: DEBUG nova.network.neutron [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Successfully created port: 1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:49:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:49:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.009s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:36 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:49:36 user nova-compute[76161]: INFO nova.compute.claims [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Claim successful on node user
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.network.neutron [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Successfully updated port: 1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquired lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.network.neutron [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-ff6d92e3-99ec-4157-95eb-e8870029f6ad req-3a0607f3-e2c7-4879-8a87-5b289277e14d service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received event network-changed-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-ff6d92e3-99ec-4157-95eb-e8870029f6ad req-3a0607f3-e2c7-4879-8a87-5b289277e14d service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Refreshing instance network info cache due to event network-changed-1441c480-e1b4-4233-a76c-d8de659dc72e. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ff6d92e3-99ec-4157-95eb-e8870029f6ad req-3a0607f3-e2c7-4879-8a87-5b289277e14d service nova] Acquiring lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.network.neutron [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.032s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:49:37 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.network.neutron [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Updating instance_info_cache with network_info: [{"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.policy [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9339a85d862547ca978fd1e73fa031a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b8c98bc4ae4aafb2686afe415fe44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Releasing lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Instance network_info: |[{"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ff6d92e3-99ec-4157-95eb-e8870029f6ad req-3a0607f3-e2c7-4879-8a87-5b289277e14d service nova] Acquired lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.network.neutron [req-ff6d92e3-99ec-4157-95eb-e8870029f6ad req-3a0607f3-e2c7-4879-8a87-5b289277e14d service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Refreshing network info cache for port 1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:49:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Start _get_guest_xml network_info=[{"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:49:38 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Creating image(s)
Nov 14 17:49:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "/opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "/opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "8de566d15c6f074d1a2edd2f1124e3a28e70207a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "8de566d15c6f074d1a2edd2f1124e3a28e70207a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:38 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:38 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1489951604',display_name='tempest-VolumesAdminNegativeTest-server-1489951604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1489951604',id=6,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsvUjZJYFeWB3CyrHlPoqE6a5WZ2VH43q9l7Beo5aHaw/xDGA/tDlJMbNoc6lAtbPiwg/phxP3y/ViqsUN7oHuh2hnzbAyxPbBTrMcBthBb6MFVXb7vnTV6iJU9vhUFCg==',key_name='tempest-keypair-353030206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c734a545ba17409c812203610ba23ab9',ramdisk_id='',reservation_id='r-jjvz35pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-826340027',owner_user_name='tempest-VolumesAdminNegativeTest-826340027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce9768ac5fdb4774874128973d9e7b35',uuid=678e458a-aeb6-4f29-b20b-74115179025f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converting VIF {"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=1441c480-e1b4-4233-a76c-d8de659dc72e,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1441c480-e1') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.objects.instance [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lazy-loading 'pci_devices' on Instance uuid 678e458a-aeb6-4f29-b20b-74115179025f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:49:38 user nova-compute[76161]:   <uuid>678e458a-aeb6-4f29-b20b-74115179025f</uuid>
Nov 14 17:49:38 user nova-compute[76161]:   <name>instance-00000006</name>
Nov 14 17:49:38 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:49:38 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:49:38 user nova-compute[76161]:   <metadata>
Nov 14 17:49:38 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:49:38 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:49:38 user nova-compute[76161]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1489951604</nova:name>
Nov 14 17:49:38 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:49:38</nova:creationTime>
Nov 14 17:49:38 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:49:38 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:49:38 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:49:38 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:49:38 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:49:38 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:49:38 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:49:38 user nova-compute[76161]:       <nova:owner>
Nov 14 17:49:38 user nova-compute[76161]:         <nova:user uuid="ce9768ac5fdb4774874128973d9e7b35">tempest-VolumesAdminNegativeTest-826340027-project-member</nova:user>
Nov 14 17:49:38 user nova-compute[76161]:         <nova:project uuid="c734a545ba17409c812203610ba23ab9">tempest-VolumesAdminNegativeTest-826340027</nova:project>
Nov 14 17:49:38 user nova-compute[76161]:       </nova:owner>
Nov 14 17:49:38 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:49:38 user nova-compute[76161]:       <nova:ports>
Nov 14 17:49:38 user nova-compute[76161]:         <nova:port uuid="1441c480-e1b4-4233-a76c-d8de659dc72e">
Nov 14 17:49:38 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 17:49:38 user nova-compute[76161]:         </nova:port>
Nov 14 17:49:38 user nova-compute[76161]:       </nova:ports>
Nov 14 17:49:38 user nova-compute[76161]:     </nova:instance>
Nov 14 17:49:38 user nova-compute[76161]:   </metadata>
Nov 14 17:49:38 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:49:38 user nova-compute[76161]:     <system>
Nov 14 17:49:38 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:49:38 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:49:38 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:49:38 user nova-compute[76161]:       <entry name="serial">678e458a-aeb6-4f29-b20b-74115179025f</entry>
Nov 14 17:49:38 user nova-compute[76161]:       <entry name="uuid">678e458a-aeb6-4f29-b20b-74115179025f</entry>
Nov 14 17:49:38 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:49:38 user nova-compute[76161]:     </system>
Nov 14 17:49:38 user nova-compute[76161]:   </sysinfo>
Nov 14 17:49:38 user nova-compute[76161]:   <os>
Nov 14 17:49:38 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:49:38 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:49:38 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:49:38 user nova-compute[76161]:   </os>
Nov 14 17:49:38 user nova-compute[76161]:   <features>
Nov 14 17:49:38 user nova-compute[76161]:     <acpi/>
Nov 14 17:49:38 user nova-compute[76161]:     <apic/>
Nov 14 17:49:38 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:49:38 user nova-compute[76161]:   </features>
Nov 14 17:49:38 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:49:38 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:49:38 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:49:38 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:49:38 user nova-compute[76161]:   </clock>
Nov 14 17:49:38 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:49:38 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:49:38 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:49:38 user nova-compute[76161]:   </cpu>
Nov 14 17:49:38 user nova-compute[76161]:   <devices>
Nov 14 17:49:38 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:49:38 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:49:38 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk"/>
Nov 14 17:49:38 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:49:38 user nova-compute[76161]:     </disk>
Nov 14 17:49:38 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:49:38 user nova-compute[76161]:       <mac address="fa:16:3e:dc:63:3e"/>
Nov 14 17:49:38 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:38 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:49:38 user nova-compute[76161]:       <target dev="tap1441c480-e1"/>
Nov 14 17:49:38 user nova-compute[76161]:     </interface>
Nov 14 17:49:38 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:49:38 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/console.log" append="off"/>
Nov 14 17:49:38 user nova-compute[76161]:     </serial>
Nov 14 17:49:38 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:49:38 user nova-compute[76161]:     <video>
Nov 14 17:49:38 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:38 user nova-compute[76161]:     </video>
Nov 14 17:49:38 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:49:38 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:49:38 user nova-compute[76161]:     </rng>
Nov 14 17:49:38 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:49:38 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:49:38 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:49:38 user nova-compute[76161]:     </memballoon>
Nov 14 17:49:38 user nova-compute[76161]:   </devices>
Nov 14 17:49:38 user nova-compute[76161]: </domain>
Nov 14 17:49:38 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1489951604',display_name='tempest-VolumesAdminNegativeTest-server-1489951604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1489951604',id=6,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsvUjZJYFeWB3CyrHlPoqE6a5WZ2VH43q9l7Beo5aHaw/xDGA/tDlJMbNoc6lAtbPiwg/phxP3y/ViqsUN7oHuh2hnzbAyxPbBTrMcBthBb6MFVXb7vnTV6iJU9vhUFCg==',key_name='tempest-keypair-353030206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c734a545ba17409c812203610ba23ab9',ramdisk_id='',reservation_id='r-jjvz35pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-826340027',owner_user_name='tempest-VolumesAdminNegativeTest-826340027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce9768ac5fdb4774874128973d9e7b35',uuid=678e458a-aeb6-4f29-b20b-74115179025f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converting VIF {"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=1441c480-e1b4-4233-a76c-d8de659dc72e,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1441c480-e1') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG os_vif [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=1441c480-e1b4-4233-a76c-d8de659dc72e,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1441c480-e1') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a.part --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11227af6-e025-5aa4-a699-342abfd4bc1a', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1441c480-e1, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1441c480-e1, col_values=(('qos', UUID('6a70b818-0caf-42d6-8794-bfd64aad1ffa')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1441c480-e1, col_values=(('external_ids', {'iface-id': '1441c480-e1b4-4233-a76c-d8de659dc72e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:63:3e', 'vm-uuid': '678e458a-aeb6-4f29-b20b-74115179025f'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:38 user nova-compute[76161]: INFO os_vif [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=1441c480-e1b4-4233-a76c-d8de659dc72e,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1441c480-e1')
Nov 14 17:49:39 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] No VIF found with MAC fa:16:3e:dc:63:3e, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a.part --force-share --output=json" returned: 0 in 0.431s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG nova.virt.images [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec was qcow2, converting to raw {{(pid=76161) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a.part /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a.converted {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Successfully created port: 7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a.part /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a.converted" returned: 0 in 0.444s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG nova.network.neutron [req-ff6d92e3-99ec-4157-95eb-e8870029f6ad req-3a0607f3-e2c7-4879-8a87-5b289277e14d service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Updated VIF entry in instance network info cache for port 1441c480-e1b4-4233-a76c-d8de659dc72e. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG nova.network.neutron [req-ff6d92e3-99ec-4157-95eb-e8870029f6ad req-3a0607f3-e2c7-4879-8a87-5b289277e14d service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Updating instance_info_cache with network_info: [{"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a.converted --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ff6d92e3-99ec-4157-95eb-e8870029f6ad req-3a0607f3-e2c7-4879-8a87-5b289277e14d service nova] Releasing lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a.converted --force-share --output=json" returned: 0 in 0.357s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "8de566d15c6f074d1a2edd2f1124e3a28e70207a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.005s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a --force-share --output=json" returned: 0 in 0.341s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "8de566d15c6f074d1a2edd2f1124e3a28e70207a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "8de566d15c6f074d1a2edd2f1124e3a28e70207a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a --force-share --output=json" returned: 0 in 0.406s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a,backing_fmt=raw /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a,backing_fmt=raw /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk 1073741824" returned: 0 in 0.080s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "8de566d15c6f074d1a2edd2f1124e3a28e70207a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.500s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a --force-share --output=json" returned: 0 in 0.453s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Successfully updated port: 7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "refresh_cache-ef928bc3-c76d-48e2-ae04-8c3c06c42998" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquired lock "refresh_cache-ef928bc3-c76d-48e2-ae04-8c3c06c42998" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG nova.compute.manager [req-356e528e-2416-4344-b791-3dfd4a3820ff req-f8fdfd6d-af8b-4936-9925-87e53fcb8fc2 service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received event network-changed-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG nova.compute.manager [req-356e528e-2416-4344-b791-3dfd4a3820ff req-f8fdfd6d-af8b-4936-9925-87e53fcb8fc2 service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Refreshing instance network info cache due to event network-changed-7d1fbf12-dfd7-4d29-9975-6e9235084613. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-356e528e-2416-4344-b791-3dfd4a3820ff req-f8fdfd6d-af8b-4936-9925-87e53fcb8fc2 service nova] Acquiring lock "refresh_cache-ef928bc3-c76d-48e2-ae04-8c3c06c42998" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk --force-share --output=json" returned: 0 in 0.381s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Cannot resize image /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Ensure instance console log exists: /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:41 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Updating instance_info_cache with network_info: [{"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Releasing lock "refresh_cache-ef928bc3-c76d-48e2-ae04-8c3c06c42998" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Instance network_info: |[{"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-356e528e-2416-4344-b791-3dfd4a3820ff req-f8fdfd6d-af8b-4936-9925-87e53fcb8fc2 service nova] Acquired lock "refresh_cache-ef928bc3-c76d-48e2-ae04-8c3c06c42998" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.network.neutron [req-356e528e-2416-4344-b791-3dfd4a3820ff req-f8fdfd6d-af8b-4936-9925-87e53fcb8fc2 service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Refreshing network info cache for port 7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Start _get_guest_xml network_info=[{"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:49:29Z,direct_url=<?>,disk_format='qcow2',id=efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec,min_disk=0,min_ram=0,name='',owner='87f6bef20b954675bbef25ad54e14541',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:49:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/sda', 'image_id': 'efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:49:42 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:42 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:49:29Z,direct_url=<?>,disk_format='qcow2',id=efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec,min_disk=0,min_ram=0,name='',owner='87f6bef20b954675bbef25ad54e14541',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:49:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-18353898',display_name='tempest-AttachSCSIVolumeTestJSON-server-18353898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-18353898',id=7,image_ref='efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0IXX9EB+eWtItPF129aDjF1MYbSgTb9nkfox3JmolLV/IbexL9fFNymYfyIasJbgYwADNKSnpuYgVOaNf10ARYTVFCgr0AtLrTdheaANRpmkjv9XAu4IdjbFqttDvfpg==',key_name='tempest-keypair-1560810522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4b8c98bc4ae4aafb2686afe415fe44c',ramdisk_id='',reservation_id='r-nr304n70',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1391122247',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1391122247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9339a85d862547ca978fd1e73fa031a3',uuid=ef928bc3-c76d-48e2-ae04-8c3c06c42998,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Converting VIF {"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:74:d5,bridge_name='br-int',has_traffic_filtering=True,id=7d1fbf12-dfd7-4d29-9975-6e9235084613,network=Network(26b2ebf7-a6ae-4877-b2ae-bd352034f238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fbf12-df') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lazy-loading 'pci_devices' on Instance uuid ef928bc3-c76d-48e2-ae04-8c3c06c42998 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:49:42 user nova-compute[76161]:   <uuid>ef928bc3-c76d-48e2-ae04-8c3c06c42998</uuid>
Nov 14 17:49:42 user nova-compute[76161]:   <name>instance-00000007</name>
Nov 14 17:49:42 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:49:42 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:49:42 user nova-compute[76161]:   <metadata>
Nov 14 17:49:42 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:49:42 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:49:42 user nova-compute[76161]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-18353898</nova:name>
Nov 14 17:49:42 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:49:42</nova:creationTime>
Nov 14 17:49:42 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:49:42 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:49:42 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:49:42 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:49:42 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:49:42 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:49:42 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:49:42 user nova-compute[76161]:       <nova:owner>
Nov 14 17:49:42 user nova-compute[76161]:         <nova:user uuid="9339a85d862547ca978fd1e73fa031a3">tempest-AttachSCSIVolumeTestJSON-1391122247-project-member</nova:user>
Nov 14 17:49:42 user nova-compute[76161]:         <nova:project uuid="b4b8c98bc4ae4aafb2686afe415fe44c">tempest-AttachSCSIVolumeTestJSON-1391122247</nova:project>
Nov 14 17:49:42 user nova-compute[76161]:       </nova:owner>
Nov 14 17:49:42 user nova-compute[76161]:       <nova:root type="image" uuid="efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec"/>
Nov 14 17:49:42 user nova-compute[76161]:       <nova:ports>
Nov 14 17:49:42 user nova-compute[76161]:         <nova:port uuid="7d1fbf12-dfd7-4d29-9975-6e9235084613">
Nov 14 17:49:42 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 17:49:42 user nova-compute[76161]:         </nova:port>
Nov 14 17:49:42 user nova-compute[76161]:       </nova:ports>
Nov 14 17:49:42 user nova-compute[76161]:     </nova:instance>
Nov 14 17:49:42 user nova-compute[76161]:   </metadata>
Nov 14 17:49:42 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:49:42 user nova-compute[76161]:     <system>
Nov 14 17:49:42 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:49:42 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:49:42 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:49:42 user nova-compute[76161]:       <entry name="serial">ef928bc3-c76d-48e2-ae04-8c3c06c42998</entry>
Nov 14 17:49:42 user nova-compute[76161]:       <entry name="uuid">ef928bc3-c76d-48e2-ae04-8c3c06c42998</entry>
Nov 14 17:49:42 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:49:42 user nova-compute[76161]:     </system>
Nov 14 17:49:42 user nova-compute[76161]:   </sysinfo>
Nov 14 17:49:42 user nova-compute[76161]:   <os>
Nov 14 17:49:42 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:49:42 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:49:42 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:49:42 user nova-compute[76161]:   </os>
Nov 14 17:49:42 user nova-compute[76161]:   <features>
Nov 14 17:49:42 user nova-compute[76161]:     <acpi/>
Nov 14 17:49:42 user nova-compute[76161]:     <apic/>
Nov 14 17:49:42 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:49:42 user nova-compute[76161]:   </features>
Nov 14 17:49:42 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:49:42 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:49:42 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:49:42 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:49:42 user nova-compute[76161]:   </clock>
Nov 14 17:49:42 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:49:42 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:49:42 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:49:42 user nova-compute[76161]:   </cpu>
Nov 14 17:49:42 user nova-compute[76161]:   <devices>
Nov 14 17:49:42 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:49:42 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:49:42 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk"/>
Nov 14 17:49:42 user nova-compute[76161]:       <target dev="sda" bus="scsi"/>
Nov 14 17:49:42 user nova-compute[76161]:       <address type="drive" controller="0" unit="0"/>
Nov 14 17:49:42 user nova-compute[76161]:     </disk>
Nov 14 17:49:42 user nova-compute[76161]:     <disk type="file" device="cdrom">
Nov 14 17:49:42 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 17:49:42 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk.config"/>
Nov 14 17:49:42 user nova-compute[76161]:       <target dev="sdb" bus="scsi"/>
Nov 14 17:49:42 user nova-compute[76161]:       <address type="drive" controller="0" unit="1"/>
Nov 14 17:49:42 user nova-compute[76161]:     </disk>
Nov 14 17:49:42 user nova-compute[76161]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 17:49:42 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:49:42 user nova-compute[76161]:       <mac address="fa:16:3e:80:74:d5"/>
Nov 14 17:49:42 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:42 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:49:42 user nova-compute[76161]:       <target dev="tap7d1fbf12-df"/>
Nov 14 17:49:42 user nova-compute[76161]:     </interface>
Nov 14 17:49:42 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:49:42 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/console.log" append="off"/>
Nov 14 17:49:42 user nova-compute[76161]:     </serial>
Nov 14 17:49:42 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:49:42 user nova-compute[76161]:     <video>
Nov 14 17:49:42 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:42 user nova-compute[76161]:     </video>
Nov 14 17:49:42 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:49:42 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:49:42 user nova-compute[76161]:     </rng>
Nov 14 17:49:42 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:49:42 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:49:42 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:49:42 user nova-compute[76161]:     </memballoon>
Nov 14 17:49:42 user nova-compute[76161]:   </devices>
Nov 14 17:49:42 user nova-compute[76161]: </domain>
Nov 14 17:49:42 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-18353898',display_name='tempest-AttachSCSIVolumeTestJSON-server-18353898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-18353898',id=7,image_ref='efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0IXX9EB+eWtItPF129aDjF1MYbSgTb9nkfox3JmolLV/IbexL9fFNymYfyIasJbgYwADNKSnpuYgVOaNf10ARYTVFCgr0AtLrTdheaANRpmkjv9XAu4IdjbFqttDvfpg==',key_name='tempest-keypair-1560810522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4b8c98bc4ae4aafb2686afe415fe44c',ramdisk_id='',reservation_id='r-nr304n70',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1391122247',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1391122247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9339a85d862547ca978fd1e73fa031a3',uuid=ef928bc3-c76d-48e2-ae04-8c3c06c42998,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Converting VIF {"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:74:d5,bridge_name='br-int',has_traffic_filtering=True,id=7d1fbf12-dfd7-4d29-9975-6e9235084613,network=Network(26b2ebf7-a6ae-4877-b2ae-bd352034f238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fbf12-df') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG os_vif [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:74:d5,bridge_name='br-int',has_traffic_filtering=True,id=7d1fbf12-dfd7-4d29-9975-6e9235084613,network=Network(26b2ebf7-a6ae-4877-b2ae-bd352034f238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fbf12-df') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92c97401-4a8c-5c0d-82f1-89c3d940bb35', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d1fbf12-df, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d1fbf12-df, col_values=(('qos', UUID('8879a517-a790-493a-a51f-854be233460b')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d1fbf12-df, col_values=(('external_ids', {'iface-id': '7d1fbf12-dfd7-4d29-9975-6e9235084613', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:74:d5', 'vm-uuid': 'ef928bc3-c76d-48e2-ae04-8c3c06c42998'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:42 user nova-compute[76161]: INFO os_vif [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:74:d5,bridge_name='br-int',has_traffic_filtering=True,id=7d1fbf12-dfd7-4d29-9975-6e9235084613,network=Network(26b2ebf7-a6ae-4877-b2ae-bd352034f238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fbf12-df')
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] No BDM found with device name sda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] No VIF found with MAC fa:16:3e:80:74:d5, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:49:42 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Using config drive
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.network.neutron [req-356e528e-2416-4344-b791-3dfd4a3820ff req-f8fdfd6d-af8b-4936-9925-87e53fcb8fc2 service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Updated VIF entry in instance network info cache for port 7d1fbf12-dfd7-4d29-9975-6e9235084613. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG nova.network.neutron [req-356e528e-2416-4344-b791-3dfd4a3820ff req-f8fdfd6d-af8b-4936-9925-87e53fcb8fc2 service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Updating instance_info_cache with network_info: [{"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-356e528e-2416-4344-b791-3dfd4a3820ff req-f8fdfd6d-af8b-4936-9925-87e53fcb8fc2 service nova] Releasing lock "refresh_cache-ef928bc3-c76d-48e2-ae04-8c3c06c42998" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:43 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Creating config drive at /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk.config
Nov 14 17:49:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpypx6ktqu {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpypx6ktqu" returned: 0 in 0.078s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "b45e1ad6-d346-442e-a957-9398103b143f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:43 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:49:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:49:44 user nova-compute[76161]: INFO nova.compute.claims [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Claim successful on node user
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:49:44 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Instance spawned successfully.
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:44 user nova-compute[76161]: INFO nova.compute.manager [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Took 10.22 seconds to spawn the instance on the hypervisor.
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:49:44 user nova-compute[76161]: INFO nova.compute.manager [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Took 13.27 seconds to build instance.
Nov 14 17:49:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fee621c0-1cec-4d82-9cee-09316fe609fe tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.595s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.763s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:49:44 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:49:44 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:49:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG nova.policy [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5af26423a8574df18c5a1292d769c3e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6199e7198cc24a739d84f79e067f4f19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:49:45 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Creating image(s)
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Acquiring lock "/opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "/opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "/opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.236s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.304s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk 1073741824" returned: 0 in 0.056s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.368s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.234s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Successfully created port: 560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Cannot resize image /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Ensure instance console log exists: /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Successfully updated port: 560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Acquiring lock "refresh_cache-b45e1ad6-d346-442e-a957-9398103b143f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Acquired lock "refresh_cache-b45e1ad6-d346-442e-a957-9398103b143f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-9f36d51e-8ad7-4929-bec5-7df0a6d05838 req-841c04cd-8abd-4c56-8862-5dee5138b19e service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-changed-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-9f36d51e-8ad7-4929-bec5-7df0a6d05838 req-841c04cd-8abd-4c56-8862-5dee5138b19e service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Refreshing instance network info cache due to event network-changed-560312f9-47a0-4257-a55a-e06dfcc78799. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9f36d51e-8ad7-4929-bec5-7df0a6d05838 req-841c04cd-8abd-4c56-8862-5dee5138b19e service nova] Acquiring lock "refresh_cache-b45e1ad6-d346-442e-a957-9398103b143f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:49:47 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Instance spawned successfully.
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.compute.manager [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-c673950f-6577-43bb-9d55-84d449fcd8f0 req-d4e9619d-149c-4866-ba22-0cbcf45c182c service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Received event network-vif-plugged-f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c673950f-6577-43bb-9d55-84d449fcd8f0 req-d4e9619d-149c-4866-ba22-0cbcf45c182c service nova] Acquiring lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c673950f-6577-43bb-9d55-84d449fcd8f0 req-d4e9619d-149c-4866-ba22-0cbcf45c182c service nova] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c673950f-6577-43bb-9d55-84d449fcd8f0 req-d4e9619d-149c-4866-ba22-0cbcf45c182c service nova] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-c673950f-6577-43bb-9d55-84d449fcd8f0 req-d4e9619d-149c-4866-ba22-0cbcf45c182c service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] No waiting events found dispatching network-vif-plugged-f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:49:47 user nova-compute[76161]: WARNING nova.compute.manager [req-c673950f-6577-43bb-9d55-84d449fcd8f0 req-d4e9619d-149c-4866-ba22-0cbcf45c182c service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Received unexpected event network-vif-plugged-f023f734-0b61-461c-b3ab-100bcf5706b6 for instance with vm_state active and task_state None.
Nov 14 17:49:48 user nova-compute[76161]: INFO nova.compute.manager [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Took 10.12 seconds to spawn the instance on the hypervisor.
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:49:48 user nova-compute[76161]: INFO nova.compute.claims [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Claim successful on node user
Nov 14 17:49:48 user nova-compute[76161]: INFO nova.compute.manager [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Took 12.07 seconds to build instance.
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Updating instance_info_cache with network_info: [{"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d51a0dc2-a601-4fae-8c4a-1981f6c65be2 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.302s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Releasing lock "refresh_cache-b45e1ad6-d346-442e-a957-9398103b143f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Instance network_info: |[{"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9f36d51e-8ad7-4929-bec5-7df0a6d05838 req-841c04cd-8abd-4c56-8862-5dee5138b19e service nova] Acquired lock "refresh_cache-b45e1ad6-d346-442e-a957-9398103b143f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.network.neutron [req-9f36d51e-8ad7-4929-bec5-7df0a6d05838 req-841c04cd-8abd-4c56-8862-5dee5138b19e service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Refreshing network info cache for port 560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Start _get_guest_xml network_info=[{"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:49:48 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:48 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1205124622',display_name='tempest-VolumesAssistedSnapshotsTest-server-1205124622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1205124622',id=8,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOe2t9rOSF854cKdmTggrueHZoFyTiFe7wHCsaHQFQh2Le4XtZZdgAilXbjhp5GJFcCKg1sxNpey5qIWUCufaQN2yedopwZ8z/XcOlNqmGKlWL40halWGIm0SaAaR6D7Q==',key_name='tempest-keypair-1597114662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6199e7198cc24a739d84f79e067f4f19',ramdisk_id='',reservation_id='r-kefuy3vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1559245320',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1559245320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5af26423a8574df18c5a1292d769c3e1',uuid=b45e1ad6-d346-442e-a957-9398103b143f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Converting VIF {"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:15:f4,bridge_name='br-int',has_traffic_filtering=True,id=560312f9-47a0-4257-a55a-e06dfcc78799,network=Network(c7725184-fac4-496b-bd9f-4a407bf3ab33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap560312f9-47') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lazy-loading 'pci_devices' on Instance uuid b45e1ad6-d346-442e-a957-9398103b143f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:49:48 user nova-compute[76161]:   <uuid>b45e1ad6-d346-442e-a957-9398103b143f</uuid>
Nov 14 17:49:48 user nova-compute[76161]:   <name>instance-00000008</name>
Nov 14 17:49:48 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:49:48 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:49:48 user nova-compute[76161]:   <metadata>
Nov 14 17:49:48 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:49:48 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:49:48 user nova-compute[76161]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1205124622</nova:name>
Nov 14 17:49:48 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:49:48</nova:creationTime>
Nov 14 17:49:48 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:49:48 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:49:48 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:49:48 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:49:48 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:49:48 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:49:48 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:49:48 user nova-compute[76161]:       <nova:owner>
Nov 14 17:49:48 user nova-compute[76161]:         <nova:user uuid="5af26423a8574df18c5a1292d769c3e1">tempest-VolumesAssistedSnapshotsTest-1559245320-project-member</nova:user>
Nov 14 17:49:48 user nova-compute[76161]:         <nova:project uuid="6199e7198cc24a739d84f79e067f4f19">tempest-VolumesAssistedSnapshotsTest-1559245320</nova:project>
Nov 14 17:49:48 user nova-compute[76161]:       </nova:owner>
Nov 14 17:49:48 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:49:48 user nova-compute[76161]:       <nova:ports>
Nov 14 17:49:48 user nova-compute[76161]:         <nova:port uuid="560312f9-47a0-4257-a55a-e06dfcc78799">
Nov 14 17:49:48 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 17:49:48 user nova-compute[76161]:         </nova:port>
Nov 14 17:49:48 user nova-compute[76161]:       </nova:ports>
Nov 14 17:49:48 user nova-compute[76161]:     </nova:instance>
Nov 14 17:49:48 user nova-compute[76161]:   </metadata>
Nov 14 17:49:48 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:49:48 user nova-compute[76161]:     <system>
Nov 14 17:49:48 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:49:48 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:49:48 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:49:48 user nova-compute[76161]:       <entry name="serial">b45e1ad6-d346-442e-a957-9398103b143f</entry>
Nov 14 17:49:48 user nova-compute[76161]:       <entry name="uuid">b45e1ad6-d346-442e-a957-9398103b143f</entry>
Nov 14 17:49:48 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:49:48 user nova-compute[76161]:     </system>
Nov 14 17:49:48 user nova-compute[76161]:   </sysinfo>
Nov 14 17:49:48 user nova-compute[76161]:   <os>
Nov 14 17:49:48 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:49:48 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:49:48 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:49:48 user nova-compute[76161]:   </os>
Nov 14 17:49:48 user nova-compute[76161]:   <features>
Nov 14 17:49:48 user nova-compute[76161]:     <acpi/>
Nov 14 17:49:48 user nova-compute[76161]:     <apic/>
Nov 14 17:49:48 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:49:48 user nova-compute[76161]:   </features>
Nov 14 17:49:48 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:49:48 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:49:48 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:49:48 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:49:48 user nova-compute[76161]:   </clock>
Nov 14 17:49:48 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:49:48 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:49:48 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:49:48 user nova-compute[76161]:   </cpu>
Nov 14 17:49:48 user nova-compute[76161]:   <devices>
Nov 14 17:49:48 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:49:48 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:49:48 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk"/>
Nov 14 17:49:48 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:49:48 user nova-compute[76161]:     </disk>
Nov 14 17:49:48 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:49:48 user nova-compute[76161]:       <mac address="fa:16:3e:5c:15:f4"/>
Nov 14 17:49:48 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:48 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:49:48 user nova-compute[76161]:       <target dev="tap560312f9-47"/>
Nov 14 17:49:48 user nova-compute[76161]:     </interface>
Nov 14 17:49:48 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:49:48 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/console.log" append="off"/>
Nov 14 17:49:48 user nova-compute[76161]:     </serial>
Nov 14 17:49:48 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:49:48 user nova-compute[76161]:     <video>
Nov 14 17:49:48 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:49:48 user nova-compute[76161]:     </video>
Nov 14 17:49:48 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:49:48 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:49:48 user nova-compute[76161]:     </rng>
Nov 14 17:49:48 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:49:48 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:49:48 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:49:48 user nova-compute[76161]:     </memballoon>
Nov 14 17:49:48 user nova-compute[76161]:   </devices>
Nov 14 17:49:48 user nova-compute[76161]: </domain>
Nov 14 17:49:48 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1205124622',display_name='tempest-VolumesAssistedSnapshotsTest-server-1205124622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1205124622',id=8,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOe2t9rOSF854cKdmTggrueHZoFyTiFe7wHCsaHQFQh2Le4XtZZdgAilXbjhp5GJFcCKg1sxNpey5qIWUCufaQN2yedopwZ8z/XcOlNqmGKlWL40halWGIm0SaAaR6D7Q==',key_name='tempest-keypair-1597114662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6199e7198cc24a739d84f79e067f4f19',ramdisk_id='',reservation_id='r-kefuy3vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1559245320',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1559245320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5af26423a8574df18c5a1292d769c3e1',uuid=b45e1ad6-d346-442e-a957-9398103b143f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Converting VIF {"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:15:f4,bridge_name='br-int',has_traffic_filtering=True,id=560312f9-47a0-4257-a55a-e06dfcc78799,network=Network(c7725184-fac4-496b-bd9f-4a407bf3ab33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap560312f9-47') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG os_vif [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:15:f4,bridge_name='br-int',has_traffic_filtering=True,id=560312f9-47a0-4257-a55a-e06dfcc78799,network=Network(c7725184-fac4-496b-bd9f-4a407bf3ab33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap560312f9-47') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1fe4eda-8b61-584f-9fe8-8338c6b96645', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap560312f9-47, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap560312f9-47, col_values=(('qos', UUID('34f7b18a-3808-482d-9cc2-7af56be55dc2')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap560312f9-47, col_values=(('external_ids', {'iface-id': '560312f9-47a0-4257-a55a-e06dfcc78799', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:15:f4', 'vm-uuid': 'b45e1ad6-d346-442e-a957-9398103b143f'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:48 user nova-compute[76161]: INFO os_vif [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:15:f4,bridge_name='br-int',has_traffic_filtering=True,id=560312f9-47a0-4257-a55a-e06dfcc78799,network=Network(c7725184-fac4-496b-bd9f-4a407bf3ab33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap560312f9-47')
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:49:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] No VIF found with MAC fa:16:3e:5c:15:f4, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.037s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG nova.network.neutron [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:49 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:49:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG nova.network.neutron [req-9f36d51e-8ad7-4929-bec5-7df0a6d05838 req-841c04cd-8abd-4c56-8862-5dee5138b19e service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Updated VIF entry in instance network info cache for port 560312f9-47a0-4257-a55a-e06dfcc78799. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG nova.network.neutron [req-9f36d51e-8ad7-4929-bec5-7df0a6d05838 req-841c04cd-8abd-4c56-8862-5dee5138b19e service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Updating instance_info_cache with network_info: [{"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG nova.policy [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e682032e8b74286b9cc47624f3f4ae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1801c743af0c4de098b6f24fd98c3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:49:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9f36d51e-8ad7-4929-bec5-7df0a6d05838 req-841c04cd-8abd-4c56-8862-5dee5138b19e service nova] Releasing lock "refresh_cache-b45e1ad6-d346-442e-a957-9398103b143f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:49 user nova-compute[76161]: INFO nova.virt.block_device [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Booting with volume c755112f-0941-40de-a17b-9d0c182004dc at /dev/vda
Nov 14 17:49:49 user nova-compute[76161]: DEBUG os_brick.utils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:49:49 user nova-compute[76161]: INFO oslo.privsep.daemon [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmptzyukp59/privsep.sock']
Nov 14 17:49:49 user sudo[86489]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmptzyukp59/privsep.sock
Nov 14 17:49:49 user sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Received event network-vif-plugged-f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Acquiring lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.016s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] No waiting events found dispatching network-vif-plugged-f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:49:50 user nova-compute[76161]: WARNING nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Received unexpected event network-vif-plugged-f023f734-0b61-461c-b3ab-100bcf5706b6 for instance with vm_state active and task_state None.
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] No waiting events found dispatching network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:49:50 user nova-compute[76161]: WARNING nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received unexpected event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 for instance with vm_state active and task_state None.
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] No waiting events found dispatching network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:49:50 user nova-compute[76161]: WARNING nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received unexpected event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 for instance with vm_state active and task_state None.
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received event network-vif-plugged-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Acquiring lock "678e458a-aeb6-4f29-b20b-74115179025f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Lock "678e458a-aeb6-4f29-b20b-74115179025f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Lock "678e458a-aeb6-4f29-b20b-74115179025f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] No waiting events found dispatching network-vif-plugged-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:49:50 user nova-compute[76161]: WARNING nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received unexpected event network-vif-plugged-1441c480-e1b4-4233-a76c-d8de659dc72e for instance with vm_state active and task_state None.
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received event network-vif-plugged-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Acquiring lock "678e458a-aeb6-4f29-b20b-74115179025f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Lock "678e458a-aeb6-4f29-b20b-74115179025f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] Lock "678e458a-aeb6-4f29-b20b-74115179025f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] No waiting events found dispatching network-vif-plugged-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:49:50 user nova-compute[76161]: WARNING nova.compute.manager [req-954313a9-631c-4b4c-be64-65690dd00df1 req-4ca5af99-f97f-4719-8b85-28073e607cec service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received unexpected event network-vif-plugged-1441c480-e1b4-4233-a76c-d8de659dc72e for instance with vm_state active and task_state None.
Nov 14 17:49:50 user nova-compute[76161]: DEBUG nova.network.neutron [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Successfully created port: 8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG nova.network.neutron [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Successfully updated port: 8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "refresh_cache-32fb9960-faa6-443a-88d3-3ee3c68b27fe" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquired lock "refresh_cache-32fb9960-faa6-443a-88d3-3ee3c68b27fe" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG nova.network.neutron [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-58e7ccbb-f3b5-46e8-a411-3a953060de72 req-751f5a44-fc85-450b-9959-be46a83345dd service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-changed-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-58e7ccbb-f3b5-46e8-a411-3a953060de72 req-751f5a44-fc85-450b-9959-be46a83345dd service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Refreshing instance network info cache due to event network-changed-8180a18a-275a-422b-bc71-e1846af90d29. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-58e7ccbb-f3b5-46e8-a411-3a953060de72 req-751f5a44-fc85-450b-9959-be46a83345dd service nova] Acquiring lock "refresh_cache-32fb9960-faa6-443a-88d3-3ee3c68b27fe" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG nova.network.neutron [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:49:51 user sudo[86489]: pam_unix(sudo:session): session closed for user root
Nov 14 17:49:51 user nova-compute[76161]: INFO oslo.privsep.daemon [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Spawned new privsep daemon via rootwrap
Nov 14 17:49:51 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 17:49:51 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 17:49:51 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 17:49:51 user nova-compute[76161]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86560
Nov 14 17:49:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a04cdd3-7f3c-44e3-828e-7c0226b16542]: (2,) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG nova.network.neutron [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Updating instance_info_cache with network_info: [{"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Releasing lock "refresh_cache-32fb9960-faa6-443a-88d3-3ee3c68b27fe" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG nova.compute.manager [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Instance network_info: |[{"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-58e7ccbb-f3b5-46e8-a411-3a953060de72 req-751f5a44-fc85-450b-9959-be46a83345dd service nova] Acquired lock "refresh_cache-32fb9960-faa6-443a-88d3-3ee3c68b27fe" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG nova.network.neutron [req-58e7ccbb-f3b5-46e8-a411-3a953060de72 req-751f5a44-fc85-450b-9959-be46a83345dd service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Refreshing network info cache for port 8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a042573-5f03-41c8-81a2-82909a04ed48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:52 user nova-compute[76161]: WARNING os_brick.initiator.connectors.nvmeof [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.034s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[144df5ae-5219-402d-843d-0fc926cc60fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b214025b-43bd-4453-914d-9b74c026873d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c2d33b-edd3-4755-ad57-9cb6a42703e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:49:52 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8d722a-d3fc-4f25-b507-87a58b5555e3]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG os_brick.utils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] <== get_connector_properties: return (2719ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Updating existing volume attachment record: 2993f33f-0350-46e4-a81b-57d4bfc52220 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG nova.network.neutron [req-58e7ccbb-f3b5-46e8-a411-3a953060de72 req-751f5a44-fc85-450b-9959-be46a83345dd service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Updated VIF entry in instance network info cache for port 8180a18a-275a-422b-bc71-e1846af90d29. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG nova.network.neutron [req-58e7ccbb-f3b5-46e8-a411-3a953060de72 req-751f5a44-fc85-450b-9959-be46a83345dd service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Updating instance_info_cache with network_info: [{"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:49:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-58e7ccbb-f3b5-46e8-a411-3a953060de72 req-751f5a44-fc85-450b-9959-be46a83345dd service nova] Releasing lock "refresh_cache-32fb9960-faa6-443a-88d3-3ee3c68b27fe" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:49:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:54 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:49:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:49:54 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Instance spawned successfully.
Nov 14 17:49:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:49:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:49:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:54 user nova-compute[76161]: INFO nova.compute.manager [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Took 9.15 seconds to spawn the instance on the hypervisor.
Nov 14 17:49:54 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:49:54 user nova-compute[76161]: INFO nova.compute.manager [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Took 10.52 seconds to build instance.
Nov 14 17:49:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6069e006-335b-45cb-a87f-471e14cd3aee tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "b45e1ad6-d346-442e-a957-9398103b143f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.694s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:49:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Creating image(s)
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Ensure instance console log exists: /opt/stack/data/nova/instances/32fb9960-faa6-443a-88d3-3ee3c68b27fe/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Start _get_guest_xml network_info=[{"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqZhQwgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32fb9960-faa6-443a-88d3-3ee3c68b27fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'c755112f-0941-40de-a17b-9d0c182004dc', 'serial': 'c755112f-0941-40de-a17b-9d0c182004dc'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '2993f33f-0350-46e4-a81b-57d4bfc52220', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:49:58 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:58 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connector [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Factory for ISCSI on None {{(pid=76161) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqZhQwgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:49:58 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:49:58 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:49:58 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[55344cc5-741f-4a9a-a0f4-05dac736cf7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:49:58 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cf7693-d789-433d-a80e-574eb61ba0b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc] added
Nov 14 17:49:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ea976d-6187-4ac9-b66d-791c24a25dff]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04555c8-c108-4a24-9418-c18e3840b3f8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqZhQwgO {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqZhQwgO" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[888b2b70-a834-4bd8-a6f4-40121dc57813]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oqZhQwgO'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee11a99-50f9-4982-9128-46b1383197c4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7336c4fc-888c-4eef-b4df-0d99e804acd2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:49:58 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:49:58 user nova-compute[76161]:  {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:49:58 user nova-compute[76161]: WARNING os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 17:49:58 user nova-compute[76161]: 
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf84a7e-0f27-41af-8c8a-f9415f60aadc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260]
Nov 14 17:49:58 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260] successful.
Nov 14 17:49:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c44be-bd45-4cd2-b15e-a8b85fd21099]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:49:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bb26fb-537c-4034-b103-014c0daa2d58]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:49:59 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:49:59 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9599b2-6251-4606-965f-f2fe286d9eed]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqZhQwgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:49:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23434346364306562', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434346364306562', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-666366678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-666366678',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0qfeGCNZ8gGzIgerfVDfT/REFNEKBmHXss/bGsLZbbzc6KURhywrEepQWnmaphwMEjeaXsblW4CfozsJdXaIg0LiAQIBG9pM3LmTWPAIyPcUriJ85J0I8eim3SdheLFg==',key_name='tempest-keypair-279762098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1801c743af0c4de098b6f24fd98c3d89',ramdisk_id='',reservation_id='r-pg3zw022',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1345728502',owner_user_name='tempest-ServerActionsV293TestJSON-1345728502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e682032e8b74286b9cc47624f3f4ae0',uuid=32fb9960-faa6-443a-88d3-3ee3c68b27fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converting VIF {"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.objects.instance [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lazy-loading 'pci_devices' on Instance uuid 32fb9960-faa6-443a-88d3-3ee3c68b27fe {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:50:00 user nova-compute[76161]:   <uuid>32fb9960-faa6-443a-88d3-3ee3c68b27fe</uuid>
Nov 14 17:50:00 user nova-compute[76161]:   <name>instance-00000009</name>
Nov 14 17:50:00 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:50:00 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:50:00 user nova-compute[76161]:   <metadata>
Nov 14 17:50:00 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:50:00 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:50:00 user nova-compute[76161]:       <nova:name>tempest-ServerActionsV293TestJSON-server-666366678</nova:name>
Nov 14 17:50:00 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:49:58</nova:creationTime>
Nov 14 17:50:00 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:50:00 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:50:00 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:50:00 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:50:00 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:50:00 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:50:00 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:50:00 user nova-compute[76161]:       <nova:owner>
Nov 14 17:50:00 user nova-compute[76161]:         <nova:user uuid="5e682032e8b74286b9cc47624f3f4ae0">tempest-ServerActionsV293TestJSON-1345728502-project-member</nova:user>
Nov 14 17:50:00 user nova-compute[76161]:         <nova:project uuid="1801c743af0c4de098b6f24fd98c3d89">tempest-ServerActionsV293TestJSON-1345728502</nova:project>
Nov 14 17:50:00 user nova-compute[76161]:       </nova:owner>
Nov 14 17:50:00 user nova-compute[76161]:       <nova:ports>
Nov 14 17:50:00 user nova-compute[76161]:         <nova:port uuid="8180a18a-275a-422b-bc71-e1846af90d29">
Nov 14 17:50:00 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 17:50:00 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:00 user nova-compute[76161]:       </nova:ports>
Nov 14 17:50:00 user nova-compute[76161]:     </nova:instance>
Nov 14 17:50:00 user nova-compute[76161]:   </metadata>
Nov 14 17:50:00 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:50:00 user nova-compute[76161]:     <system>
Nov 14 17:50:00 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:50:00 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:50:00 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:50:00 user nova-compute[76161]:       <entry name="serial">32fb9960-faa6-443a-88d3-3ee3c68b27fe</entry>
Nov 14 17:50:00 user nova-compute[76161]:       <entry name="uuid">32fb9960-faa6-443a-88d3-3ee3c68b27fe</entry>
Nov 14 17:50:00 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:50:00 user nova-compute[76161]:     </system>
Nov 14 17:50:00 user nova-compute[76161]:   </sysinfo>
Nov 14 17:50:00 user nova-compute[76161]:   <os>
Nov 14 17:50:00 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:50:00 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:50:00 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:50:00 user nova-compute[76161]:   </os>
Nov 14 17:50:00 user nova-compute[76161]:   <features>
Nov 14 17:50:00 user nova-compute[76161]:     <acpi/>
Nov 14 17:50:00 user nova-compute[76161]:     <apic/>
Nov 14 17:50:00 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:50:00 user nova-compute[76161]:   </features>
Nov 14 17:50:00 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:50:00 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:50:00 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:50:00 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:50:00 user nova-compute[76161]:   </clock>
Nov 14 17:50:00 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:50:00 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:50:00 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:50:00 user nova-compute[76161]:   </cpu>
Nov 14 17:50:00 user nova-compute[76161]:   <devices>
Nov 14 17:50:00 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:50:00 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:50:00 user nova-compute[76161]:       <source dev="/dev/sdb"/>
Nov 14 17:50:00 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:50:00 user nova-compute[76161]:       <serial>c755112f-0941-40de-a17b-9d0c182004dc</serial>
Nov 14 17:50:00 user nova-compute[76161]:     </disk>
Nov 14 17:50:00 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:00 user nova-compute[76161]:       <mac address="fa:16:3e:26:2c:18"/>
Nov 14 17:50:00 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:00 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:00 user nova-compute[76161]:       <target dev="tap8180a18a-27"/>
Nov 14 17:50:00 user nova-compute[76161]:     </interface>
Nov 14 17:50:00 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:50:00 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/32fb9960-faa6-443a-88d3-3ee3c68b27fe/console.log" append="off"/>
Nov 14 17:50:00 user nova-compute[76161]:     </serial>
Nov 14 17:50:00 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:50:00 user nova-compute[76161]:     <video>
Nov 14 17:50:00 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:00 user nova-compute[76161]:     </video>
Nov 14 17:50:00 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:50:00 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:50:00 user nova-compute[76161]:     </rng>
Nov 14 17:50:00 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:50:00 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:50:00 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:50:00 user nova-compute[76161]:     </memballoon>
Nov 14 17:50:00 user nova-compute[76161]:   </devices>
Nov 14 17:50:00 user nova-compute[76161]: </domain>
Nov 14 17:50:00 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-666366678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-666366678',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0qfeGCNZ8gGzIgerfVDfT/REFNEKBmHXss/bGsLZbbzc6KURhywrEepQWnmaphwMEjeaXsblW4CfozsJdXaIg0LiAQIBG9pM3LmTWPAIyPcUriJ85J0I8eim3SdheLFg==',key_name='tempest-keypair-279762098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1801c743af0c4de098b6f24fd98c3d89',ramdisk_id='',reservation_id='r-pg3zw022',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1345728502',owner_user_name='tempest-ServerActionsV293TestJSON-1345728502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e682032e8b74286b9cc47624f3f4ae0',uuid=32fb9960-faa6-443a-88d3-3ee3c68b27fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converting VIF {"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG os_vif [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd505f9e-d669-5077-b888-78e7baebebe8', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8180a18a-27, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8180a18a-27, col_values=(('qos', UUID('dec9d9b3-46b8-4b5b-9139-8a33fa497a1c')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8180a18a-27, col_values=(('external_ids', {'iface-id': '8180a18a-275a-422b-bc71-e1846af90d29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:2c:18', 'vm-uuid': '32fb9960-faa6-443a-88d3-3ee3c68b27fe'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:00 user nova-compute[76161]: INFO os_vif [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27')
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:50:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] No VIF found with MAC fa:16:3e:26:2c:18, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:50:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-b02f3bc8-5763-481d-9c40-fc8b79cc6c9e req-e42b47b0-41b5-4695-88aa-559dea504a2a service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b02f3bc8-5763-481d-9c40-fc8b79cc6c9e req-e42b47b0-41b5-4695-88aa-559dea504a2a service nova] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b02f3bc8-5763-481d-9c40-fc8b79cc6c9e req-e42b47b0-41b5-4695-88aa-559dea504a2a service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b02f3bc8-5763-481d-9c40-fc8b79cc6c9e req-e42b47b0-41b5-4695-88aa-559dea504a2a service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-b02f3bc8-5763-481d-9c40-fc8b79cc6c9e req-e42b47b0-41b5-4695-88aa-559dea504a2a service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] No waiting events found dispatching network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:02 user nova-compute[76161]: WARNING nova.compute.manager [req-b02f3bc8-5763-481d-9c40-fc8b79cc6c9e req-e42b47b0-41b5-4695-88aa-559dea504a2a service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received unexpected event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 for instance with vm_state building and task_state spawning.
Nov 14 17:50:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 17:50:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] There are 0 instances to clean {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 17:50:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76161) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 17:50:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:50:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:50:04 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Instance spawned successfully.
Nov 14 17:50:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:50:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:04 user nova-compute[76161]: INFO nova.compute.manager [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 14 17:50:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:50:04 user nova-compute[76161]: INFO nova.compute.manager [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Took 16.44 seconds to build instance.
Nov 14 17:50:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30f52199-37de-45ae-890b-3b30669f2e04 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.663s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-f834c626-2677-4a66-adcb-8e0fe16f343b req-471d7d77-7026-41cc-b06f-068b6306c662 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f834c626-2677-4a66-adcb-8e0fe16f343b req-471d7d77-7026-41cc-b06f-068b6306c662 service nova] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f834c626-2677-4a66-adcb-8e0fe16f343b req-471d7d77-7026-41cc-b06f-068b6306c662 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f834c626-2677-4a66-adcb-8e0fe16f343b req-471d7d77-7026-41cc-b06f-068b6306c662 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-f834c626-2677-4a66-adcb-8e0fe16f343b req-471d7d77-7026-41cc-b06f-068b6306c662 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] No waiting events found dispatching network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:05 user nova-compute[76161]: WARNING nova.compute.manager [req-f834c626-2677-4a66-adcb-8e0fe16f343b req-471d7d77-7026-41cc-b06f-068b6306c662 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received unexpected event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 for instance with vm_state active and task_state None.
Nov 14 17:50:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "bc0af785-ac5b-4103-97e2-83285d9154da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:50:05 user nova-compute[76161]: INFO nova.compute.claims [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Claim successful on node user
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Skipping network cache update for instance because it is Building. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:50:06 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:50:06 user nova-compute[76161]: INFO nova.virt.block_device [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Booting with volume dfcdf194-0478-45fa-8da0-9a1aa69238f8 at /dev/vda
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:50:06 user nova-compute[76161]: INFO nova.compute.claims [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Claim successful on node user
Nov 14 17:50:06 user nova-compute[76161]: DEBUG os_brick.utils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef9de23-1d18-433f-95e7-887c651f1be3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a65af6-66a6-4cb0-b859-975ae8e53c0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.policy [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '659819be1e544005b018b937d23fa6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a701f0dab64fc68396669c7ac14f9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[477bc530-a232-49d0-8d55-b9a08b87b2ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1703283-f657-490c-b2ca-1ef22288bd2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:06 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:50:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[43be9d93-5dc5-46d2-ba94-e1711828b34e]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG os_brick.utils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:06 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating existing volume attachment record: 03ab053a-a88e-4567-8b9e-62d4248e0244 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Updating instance_info_cache with network_info: [{"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.702s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:50:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.policy [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f032554742874fd1b86a0a9019c4418c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46f69a7d5c4578b58c89fd04bfe824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:50:07 user nova-compute[76161]: INFO nova.virt.block_device [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Booting with volume a025f514-8a66-4a0a-a24f-f3023cb869ed at /dev/vda
Nov 14 17:50:07 user nova-compute[76161]: DEBUG os_brick.utils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully created port: dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8606d18-abe2-491b-9e29-45bb22bb1dad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f0dbea-427a-4322-878a-888fec5a9d30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a37efee-1314-41a9-887d-f371c8974d81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a921748e-af7a-4067-bf02-e22e000e51dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:07 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:50:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2e3348-998d-4b59-8490-54ac71c57e33]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG os_brick.utils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:07 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating existing volume attachment record: 3976b967-9203-42ef-a8a4-31717bd0ba03 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully created port: 72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully created port: 18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully created port: ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully created port: e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully created port: e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-41bc310d-cf1b-4072-902a-0008acdf99b5 req-3e918521-9a92-4d87-9875-168a4b315a04 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Received event network-vif-plugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-41bc310d-cf1b-4072-902a-0008acdf99b5 req-3e918521-9a92-4d87-9875-168a4b315a04 service nova] Acquiring lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-41bc310d-cf1b-4072-902a-0008acdf99b5 req-3e918521-9a92-4d87-9875-168a4b315a04 service nova] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-41bc310d-cf1b-4072-902a-0008acdf99b5 req-3e918521-9a92-4d87-9875-168a4b315a04 service nova] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-41bc310d-cf1b-4072-902a-0008acdf99b5 req-3e918521-9a92-4d87-9875-168a4b315a04 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] No waiting events found dispatching network-vif-plugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:10 user nova-compute[76161]: WARNING nova.compute.manager [req-41bc310d-cf1b-4072-902a-0008acdf99b5 req-3e918521-9a92-4d87-9875-168a4b315a04 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Received unexpected event network-vif-plugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 for instance with vm_state active and task_state None.
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully created port: 05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully created port: 11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:50:11 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully created port: be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:12 user nova-compute[76161]: INFO nova.virt.block_device [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Booting with volume d59719bd-db14-446f-8481-c70f6f2acb2f at /dev/vdb
Nov 14 17:50:12 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:50:12 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7335MB free_disk=25.596363067626953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully updated port: dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG os_brick.utils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b30c47-9f6e-4ef2-9743-1b2a0b89fe3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-1abb5beb-ec94-46d7-9be7-8c6cc9048711 req-71dd8536-dd77-44e6-8a38-82751fa6c3db service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-changed-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-1abb5beb-ec94-46d7-9be7-8c6cc9048711 req-71dd8536-dd77-44e6-8a38-82751fa6c3db service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing instance network info cache due to event network-changed-dc4feb84-e8d8-471c-b343-9cc484201a86. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1abb5beb-ec94-46d7-9be7-8c6cc9048711 req-71dd8536-dd77-44e6-8a38-82751fa6c3db service nova] Acquiring lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1abb5beb-ec94-46d7-9be7-8c6cc9048711 req-71dd8536-dd77-44e6-8a38-82751fa6c3db service nova] Acquired lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.network.neutron [req-1abb5beb-ec94-46d7-9be7-8c6cc9048711 req-71dd8536-dd77-44e6-8a38-82751fa6c3db service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing network info cache for port dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dc3318-1b2f-4336-ab1e-aaad6788186b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b568b8b-511b-4158-b1ed-d4de662affbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1252a26b-2cb4-4886-8d76-3c8f667959ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Received event network-vif-plugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] Acquiring lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] No waiting events found dispatching network-vif-plugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:12 user nova-compute[76161]: WARNING nova.compute.manager [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Received unexpected event network-vif-plugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 for instance with vm_state active and task_state None.
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:12 user nova-compute[76161]: WARNING nova.compute.manager [req-f0335bb9-7a24-4e7b-8643-db40d2fa6f54 req-feee854f-83ea-427c-b352-83d88437cdf9 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state active and task_state None.
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:12 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:50:12 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[882cb884-9fe2-4850-9bbf-06412f08412c]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG os_brick.utils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating existing volume attachment record: f5866b9a-423b-4dd3-8ad8-b8ebce15776c {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:50:12 user nova-compute[76161]: DEBUG nova.network.neutron [req-1abb5beb-ec94-46d7-9be7-8c6cc9048711 req-71dd8536-dd77-44e6-8a38-82751fa6c3db service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully created port: 4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance f8c62b07-2d5b-4619-98ec-b77eb524829a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56f47238-81fe-4196-865c-e1ad68cf6fea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 678e458a-aeb6-4f29-b20b-74115179025f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance ef928bc3-c76d-48e2-ae04-8c3c06c42998 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b45e1ad6-d346-442e-a957-9398103b143f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 32fb9960-faa6-443a-88d3-3ee3c68b27fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bc0af785-ac5b-4103-97e2-83285d9154da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 11cabda6-8cc9-481f-b91c-5fd359e98515 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing inventories for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 17:50:13 user nova-compute[76161]: INFO nova.virt.block_device [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Booting with volume 6327b23e-67c0-46fe-9ce5-45f61c584d5b at /dev/vdb
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating ProviderTree inventory for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing aggregate associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, aggregates: None {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG os_brick.utils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38e59fd-7fa4-4981-9dd5-b7f10c0d5e87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing trait associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully updated port: 497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e0e864-3cb1-43cb-80cc-0c9a06f80ec0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.network.neutron [req-1abb5beb-ec94-46d7-9be7-8c6cc9048711 req-71dd8536-dd77-44e6-8a38-82751fa6c3db service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1abb5beb-ec94-46d7-9be7-8c6cc9048711 req-71dd8536-dd77-44e6-8a38-82751fa6c3db service nova] Releasing lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d20e3c-d535-4dd9-b2b0-59851a82b815]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a022fc7-7a88-4272-a38c-a7f70b57fe84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:13 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0180e799-ced2-49a0-8d63-15d21ab4f580]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG os_brick.utils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating existing volume attachment record: 157650c9-1662-45bc-a79b-293faab144b3 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:50:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.340s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-e80c6271-0942-4792-9bd4-201dc6e6c439 req-31786c34-d5b1-4c85-996b-2233bbd6f40a service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-changed-497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-e80c6271-0942-4792-9bd4-201dc6e6c439 req-31786c34-d5b1-4c85-996b-2233bbd6f40a service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing instance network info cache due to event network-changed-497ff416-9e25-4b65-915b-46b01d17e41f. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e80c6271-0942-4792-9bd4-201dc6e6c439 req-31786c34-d5b1-4c85-996b-2233bbd6f40a service nova] Acquiring lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e80c6271-0942-4792-9bd4-201dc6e6c439 req-31786c34-d5b1-4c85-996b-2233bbd6f40a service nova] Acquired lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-e80c6271-0942-4792-9bd4-201dc6e6c439 req-31786c34-d5b1-4c85-996b-2233bbd6f40a service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing network info cache for port 497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-e80c6271-0942-4792-9bd4-201dc6e6c439 req-31786c34-d5b1-4c85-996b-2233bbd6f40a service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully updated port: 359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-eecdfb07-858f-4c64-aaf8-c700c609a088 req-7fe92231-0fd7-4376-8992-a30e4eaa60af service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-changed-359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-eecdfb07-858f-4c64-aaf8-c700c609a088 req-7fe92231-0fd7-4376-8992-a30e4eaa60af service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing instance network info cache due to event network-changed-359d13b0-99ca-481b-a09e-f1d54046f9c8. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-eecdfb07-858f-4c64-aaf8-c700c609a088 req-7fe92231-0fd7-4376-8992-a30e4eaa60af service nova] Acquiring lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:14 user nova-compute[76161]: WARNING nova.compute.manager [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state active and task_state None.
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received event network-vif-plugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] Acquiring lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] No waiting events found dispatching network-vif-plugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:14 user nova-compute[76161]: WARNING nova.compute.manager [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received unexpected event network-vif-plugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 for instance with vm_state active and task_state None.
Nov 14 17:50:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received event network-vif-plugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] Acquiring lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] No waiting events found dispatching network-vif-plugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:15 user nova-compute[76161]: WARNING nova.compute.manager [req-0e520517-a5b3-45ed-9760-b1f1b5a075b2 req-553c58e2-c17f-4baf-b274-6c5d702d7982 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received unexpected event network-vif-plugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 for instance with vm_state active and task_state None.
Nov 14 17:50:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-e80c6271-0942-4792-9bd4-201dc6e6c439 req-31786c34-d5b1-4c85-996b-2233bbd6f40a service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e80c6271-0942-4792-9bd4-201dc6e6c439 req-31786c34-d5b1-4c85-996b-2233bbd6f40a service nova] Releasing lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-eecdfb07-858f-4c64-aaf8-c700c609a088 req-7fe92231-0fd7-4376-8992-a30e4eaa60af service nova] Acquired lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-eecdfb07-858f-4c64-aaf8-c700c609a088 req-7fe92231-0fd7-4376-8992-a30e4eaa60af service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing network info cache for port 359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:15 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully updated port: 72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-eecdfb07-858f-4c64-aaf8-c700c609a088 req-7fe92231-0fd7-4376-8992-a30e4eaa60af service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-eecdfb07-858f-4c64-aaf8-c700c609a088 req-7fe92231-0fd7-4376-8992-a30e4eaa60af service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-eecdfb07-858f-4c64-aaf8-c700c609a088 req-7fe92231-0fd7-4376-8992-a30e4eaa60af service nova] Releasing lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:15 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully updated port: ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully updated port: d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully updated port: e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully updated port: fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-changed-ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing instance network info cache due to event network-changed-ff41f832-98a2-4858-9afc-b6df0c638ed7. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] Acquiring lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] Acquired lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing network info cache for port ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-changed-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing instance network info cache due to event network-changed-72a8f902-4304-40a0-ae7f-308ddf7e4956. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] Acquiring lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] Acquired lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing network info cache for port 72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] Releasing lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-changed-e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing instance network info cache due to event network-changed-e235037a-3ce6-4f04-a2f1-8e02958c47b9. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] Acquiring lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] Acquired lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing network info cache for port e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully updated port: 11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-11134cb0-7486-4863-af86-7aa49e5c1187 req-b044e80b-aa68-4374-a867-f1df4bb95b8b service nova] Releasing lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] Releasing lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-changed-d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing instance network info cache due to event network-changed-d6ff8d78-d459-4b93-9858-152428ce2cf9. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] Acquiring lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] Acquired lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing network info cache for port d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully updated port: 18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.network.neutron [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] Releasing lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-changed-fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing instance network info cache due to event network-changed-fbd5f82c-3c9c-4b63-807a-3af5841746a4. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] Acquiring lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] Acquired lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.network.neutron [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing network info cache for port fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:18 user nova-compute[76161]: INFO nova.virt.block_device [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Booting with volume 4b10766f-5218-4d44-b0ed-153e34460108 at /dev/vdc
Nov 14 17:50:18 user nova-compute[76161]: DEBUG os_brick.utils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.network.neutron [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee8d2ed-216b-4463-b1c7-3928f1a35257]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4977bc1c-5e66-4b84-bac1-a03227b82de5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e7103-2511-45f2-b0a6-9bf381d55828]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[801bf9e6-96a8-4e36-90b1-d85ffc8aa5b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:18 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4f9e81-4b37-409b-811b-7b0e89a2ad2a]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG os_brick.utils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating existing volume attachment record: 0d236ed4-badb-419f-ba52-ed06674f2607 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.network.neutron [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Successfully updated port: be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9921d81b-1271-4b8f-bdb5-dbcb283699fe req-ef8a7dea-eaaf-4377-9cf7-2f7630e528b3 service nova] Releasing lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquired lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:18 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully updated port: e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:19 user nova-compute[76161]: INFO nova.virt.block_device [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Booting with volume d8f2c208-12e7-4583-ac16-15a172993fd3 at /dev/vdc
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-changed-11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing instance network info cache due to event network-changed-11a6406d-86f0-4ef2-8541-60f6ae8e5cef. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] Acquiring lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG os_brick.utils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bf6ce6-f9d9-4b63-9d1c-adba837ea34c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-changed-18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing instance network info cache due to event network-changed-18f649cd-267b-41cf-a249-cec8fd1e6b4e. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] Acquiring lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] Acquired lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.network.neutron [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing network info cache for port 18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1adbbb-c170-4ad0-8e6f-5b868316a4fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b0edcb-1abf-4b88-9977-64d8d4563cbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee7070b-b660-42b4-afa1-b890a06f6165]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:50:19 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8db9c60-cffd-4833-a754-c3791b49a681]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG os_brick.utils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating existing volume attachment record: b8d00738-c9a2-474b-b1c4-b021d8605cdb {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.network.neutron [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully updated port: 05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.network.neutron [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] Releasing lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-changed-e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing instance network info cache due to event network-changed-e13e7508-0ac3-419f-b854-fb081e44aa65. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] Acquiring lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] Acquired lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.network.neutron [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing network info cache for port e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:19 user nova-compute[76161]: DEBUG nova.network.neutron [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Successfully updated port: 4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-8cfaf6ee-ea1c-4fbb-992d-5f0303040b95 req-b2184a8d-1379-4ce3-bbce-768163fca2dd service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-changed-4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-8cfaf6ee-ea1c-4fbb-992d-5f0303040b95 req-b2184a8d-1379-4ce3-bbce-768163fca2dd service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing instance network info cache due to event network-changed-4ee1239f-391c-4006-af98-3beaffe581bc. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8cfaf6ee-ea1c-4fbb-992d-5f0303040b95 req-b2184a8d-1379-4ce3-bbce-768163fca2dd service nova] Acquiring lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG nova.network.neutron [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-85c78a92-aecc-40a7-b6eb-e05cf3624142 req-27aa6857-f249-447b-abe6-6012cecb4aaf service nova] Releasing lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquired lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG nova.network.neutron [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [{"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Releasing lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Instance network_info: |[{"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] Acquired lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:20 user nova-compute[76161]: DEBUG nova.network.neutron [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing network info cache for port 11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-7f73465a-a52b-49f9-b5c9-0f1fb63f0113 req-3cf8f8d3-6dec-4e46-a28b-56ec36b0c498 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-changed-05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-7f73465a-a52b-49f9-b5c9-0f1fb63f0113 req-3cf8f8d3-6dec-4e46-a28b-56ec36b0c498 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing instance network info cache due to event network-changed-05b9f44c-73e6-40e5-afb5-96fd9a196210. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7f73465a-a52b-49f9-b5c9-0f1fb63f0113 req-3cf8f8d3-6dec-4e46-a28b-56ec36b0c498 service nova] Acquiring lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG nova.network.neutron [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updated VIF entry in instance network info cache for port 11a6406d-86f0-4ef2-8541-60f6ae8e5cef. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG nova.network.neutron [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [{"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] Releasing lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-changed-be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing instance network info cache due to event network-changed-be8ed683-01f8-4816-a455-02a3e65a580e. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] Acquiring lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] Acquired lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG nova.network.neutron [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing network info cache for port be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG nova.network.neutron [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updated VIF entry in instance network info cache for port be8ed683-01f8-4816-a455-02a3e65a580e. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG nova.network.neutron [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [{"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-12042660-0d0e-4d2e-b50e-38ce132350d6 req-99d973e9-66a0-44e0-b103-1dde80e722fc service nova] Releasing lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [{"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Releasing lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Instance network_info: |[{"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8cfaf6ee-ea1c-4fbb-992d-5f0303040b95 req-b2184a8d-1379-4ce3-bbce-768163fca2dd service nova] Acquired lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-8cfaf6ee-ea1c-4fbb-992d-5f0303040b95 req-b2184a8d-1379-4ce3-bbce-768163fca2dd service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing network info cache for port 4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received event network-vif-plugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Acquiring lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] No waiting events found dispatching network-vif-plugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:23 user nova-compute[76161]: WARNING nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received unexpected event network-vif-plugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 for instance with vm_state active and task_state None.
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received event network-vif-plugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Acquiring lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] No waiting events found dispatching network-vif-plugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:23 user nova-compute[76161]: WARNING nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received unexpected event network-vif-plugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 for instance with vm_state active and task_state None.
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] No waiting events found dispatching network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:23 user nova-compute[76161]: WARNING nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received unexpected event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 for instance with vm_state active and task_state None.
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] No waiting events found dispatching network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:23 user nova-compute[76161]: WARNING nova.compute.manager [req-7ba0d3ad-8d8d-42ad-881e-33ad14b5d971 req-ae2c323d-05b7-4143-b5b8-74af3d88639f service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received unexpected event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 for instance with vm_state active and task_state None.
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:50:23 user nova-compute[76161]: INFO nova.compute.claims [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Claim successful on node user
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:50:23 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Creating image(s)
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Ensure instance console log exists: /opt/stack/data/nova/instances/bc0af785-ac5b-4103-97e2-83285d9154da/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Start _get_guest_xml network_info=[{"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNTARMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc0af785-ac5b-4103-97e2-83285d9154da', 'attached_at': '', 'detached_at': '', 'volume_id': 'dfcdf194-0478-45fa-8da0-9a1aa69238f8', 'serial': 'dfcdf194-0478-45fa-8da0-9a1aa69238f8'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '03ab053a-a88e-4567-8b9e-62d4248e0244', 'mount_device': '/dev/vda', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPSeCwAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc0af785-ac5b-4103-97e2-83285d9154da', 'attached_at': '', 'detached_at': '', 'volume_id': 'd59719bd-db14-446f-8481-c70f6f2acb2f', 'serial': 'd59719bd-db14-446f-8481-c70f6f2acb2f'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'f5866b9a-423b-4dd3-8ad8-b8ebce15776c', 'mount_device': '/dev/vdb', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKUCubJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc0af785-ac5b-4103-97e2-83285d9154da', 'attached_at': '', 'detached_at': '', 'volume_id': '4b10766f-5218-4d44-b0ed-153e34460108', 'serial': '4b10766f-5218-4d44-b0ed-153e34460108'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '0d236ed4-badb-419f-ba52-ed06674f2607', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:50:23 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:50:23 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNTARMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:23 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:23 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:23 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a490ae54-dc3a-4c88-8542-d6bd0ff7c3ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:50:23 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cf7a56-026d-46bf-b8bf-ac76f4f844dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8] added
Nov 14 17:50:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6497e117-ab59-458f-81f8-bb0430ebdc9a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-8cfaf6ee-ea1c-4fbb-992d-5f0303040b95 req-b2184a8d-1379-4ce3-bbce-768163fca2dd service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updated VIF entry in instance network info cache for port 4ee1239f-391c-4006-af98-3beaffe581bc. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-8cfaf6ee-ea1c-4fbb-992d-5f0303040b95 req-b2184a8d-1379-4ce3-bbce-768163fca2dd service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [{"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[063173f9-f7d5-4c22-937f-02d28da2750b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8cfaf6ee-ea1c-4fbb-992d-5f0303040b95 req-b2184a8d-1379-4ce3-bbce-768163fca2dd service nova] Releasing lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xoNTARMu {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7f73465a-a52b-49f9-b5c9-0f1fb63f0113 req-3cf8f8d3-6dec-4e46-a28b-56ec36b0c498 service nova] Acquired lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-7f73465a-a52b-49f9-b5c9-0f1fb63f0113 req-3cf8f8d3-6dec-4e46-a28b-56ec36b0c498 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing network info cache for port 05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xoNTARMu" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda53e9a-0233-46dd-a5fe-4c473faa8a21]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xoNTARMu'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82fed78-a7be-4a78-831a-e7b8112f986d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[537d0686-d0fc-46d4-bb1e-858172192615]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2c421e-bf05-452c-9889-9d791dc0f52f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8, portal: 172.16.0.220,3260]
Nov 14 17:50:23 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8, portal: 172.16.0.220,3260] successful.
Nov 14 17:50:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be0f3ff-09d4-4af9-a61e-714036bc1260]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c543202c-2801-436d-902d-fd547e0e3df0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:23 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:23 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8b83b4-577c-4e42-9c9a-a7a415fb6a9d]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNTARMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:50:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.policy [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '470be45a97bd464b9d22b2fb6f97cf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9d6960a8574bf5879639b40b156a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:50:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Creating image(s)
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "/opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "/opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:50:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Creating image(s)
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Ensure instance console log exists: /opt/stack/data/nova/instances/11cabda6-8cc9-481f-b91c-5fd359e98515/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Start _get_guest_xml network_info=[{"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KgzIUnEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11cabda6-8cc9-481f-b91c-5fd359e98515', 'attached_at': '', 'detached_at': '', 'volume_id': 'a025f514-8a66-4a0a-a24f-f3023cb869ed', 'serial': 'a025f514-8a66-4a0a-a24f-f3023cb869ed'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '3976b967-9203-42ef-a8a4-31717bd0ba03', 'mount_device': '/dev/vda', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrxhpytl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11cabda6-8cc9-481f-b91c-5fd359e98515', 'attached_at': '', 'detached_at': '', 'volume_id': '6327b23e-67c0-46fe-9ce5-45f61c584d5b', 'serial': '6327b23e-67c0-46fe-9ce5-45f61c584d5b'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '157650c9-1662-45bc-a79b-293faab144b3', 'mount_device': '/dev/vdb', 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqWbZGgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11cabda6-8cc9-481f-b91c-5fd359e98515', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8f2c208-12e7-4583-ac16-15a172993fd3', 'serial': 'd8f2c208-12e7-4583-ac16-15a172993fd3'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'b8d00738-c9a2-474b-b1c4-b021d8605cdb', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:50:24 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:50:24 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KgzIUnEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:24 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.network.neutron [req-7f73465a-a52b-49f9-b5c9-0f1fb63f0113 req-3cf8f8d3-6dec-4e46-a28b-56ec36b0c498 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updated VIF entry in instance network info cache for port 05b9f44c-73e6-40e5-afb5-96fd9a196210. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.network.neutron [req-7f73465a-a52b-49f9-b5c9-0f1fb63f0113 req-3cf8f8d3-6dec-4e46-a28b-56ec36b0c498 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [{"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7f73465a-a52b-49f9-b5c9-0f1fb63f0113 req-3cf8f8d3-6dec-4e46-a28b-56ec36b0c498 service nova] Releasing lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk 1073741824" returned: 0 in 0.055s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26164626162666339', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164626162666339', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.454s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:24 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:24 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:50:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[628c23d1-b82a-4130-ad87-1b508513de3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:50:25 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPSeCwAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:25 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b564ea4-5be7-4f6d-a7b8-035799d794b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed] added
Nov 14 17:50:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.211s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Successfully created port: 9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2b1871-51d1-4af5-b993-4ba17a795a25]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac6618-ebd2-41b6-9256-e6d157809a23]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KgzIUnEY {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KgzIUnEY" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b07c29-079b-42bf-9895-ab4658904f97]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KgzIUnEY'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb23e60f-a284-46e3-bfd8-3f1ecbe65d72]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[52beeb19-cbee-4a6c-aab4-1b3d7c5a9275]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:25 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:25 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Cannot resize image /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Ensure instance console log exists: /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[371a5651-d2ec-4437-a0d8-87e7ac2a6a24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed, portal: 172.16.0.220,3260]
Nov 14 17:50:25 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed, portal: 172.16.0.220,3260] successful.
Nov 14 17:50:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c8ce2a-a271-48b0-8d60-c971100f3260]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eb0286-fed3-4572-9a3e-f157ef56e259]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:25 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:25 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:25 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:25 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8414ae-8d25-404d-b4a5-d1c3ec560807]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KgzIUnEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Successfully updated port: 9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "refresh_cache-2ade3f5e-24a0-4989-854a-f4a90e5cf30a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquired lock "refresh_cache-2ade3f5e-24a0-4989-854a-f4a90e5cf30a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f77b0e1-cd1b-4611-a235-3084f4d9db57 req-44b9c20d-9ab9-4e6d-8c51-2cd68f6a9d33 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received event network-changed-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f77b0e1-cd1b-4611-a235-3084f4d9db57 req-44b9c20d-9ab9-4e6d-8c51-2cd68f6a9d33 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Refreshing instance network info cache due to event network-changed-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f77b0e1-cd1b-4611-a235-3084f4d9db57 req-44b9c20d-9ab9-4e6d-8c51-2cd68f6a9d33 service nova] Acquiring lock "refresh_cache-2ade3f5e-24a0-4989-854a-f4a90e5cf30a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:50:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Updating instance_info_cache with network_info: [{"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Releasing lock "refresh_cache-2ade3f5e-24a0-4989-854a-f4a90e5cf30a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Instance network_info: |[{"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f77b0e1-cd1b-4611-a235-3084f4d9db57 req-44b9c20d-9ab9-4e6d-8c51-2cd68f6a9d33 service nova] Acquired lock "refresh_cache-2ade3f5e-24a0-4989-854a-f4a90e5cf30a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-1f77b0e1-cd1b-4611-a235-3084f4d9db57 req-44b9c20d-9ab9-4e6d-8c51-2cd68f6a9d33 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Refreshing network info cache for port 9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Start _get_guest_xml network_info=[{"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:50:26 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:50:26 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1060209255',display_name='tempest-VolumesSnapshotTestJSON-instance-1060209255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1060209255',id=12,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIa9deK2vCKuisnbPqZ1BnyqGrG3V2AjClocao4NNpRJ9L0536oPP/E+r2m64tptl5uHSbwUYjo16AStNDNXZPVv65RDeRKyfgEbjfT06Mr4DR576OWHFszqSS7LLxU3A==',key_name='tempest-keypair-1362659200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec9d6960a8574bf5879639b40b156a86',ramdisk_id='',reservation_id='r-iimck8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-688447987',owner_user_name='tempest-VolumesSnapshotTestJSON-688447987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='470be45a97bd464b9d22b2fb6f97cf95',uuid=2ade3f5e-24a0-4989-854a-f4a90e5cf30a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converting VIF {"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=9e624cc1-9ddd-4a4d-924d-1aecdcc84c90,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e624cc1-9d') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ade3f5e-24a0-4989-854a-f4a90e5cf30a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:50:26 user nova-compute[76161]:   <uuid>2ade3f5e-24a0-4989-854a-f4a90e5cf30a</uuid>
Nov 14 17:50:26 user nova-compute[76161]:   <name>instance-0000000c</name>
Nov 14 17:50:26 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:50:26 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:50:26 user nova-compute[76161]:   <metadata>
Nov 14 17:50:26 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:50:26 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:50:26 user nova-compute[76161]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1060209255</nova:name>
Nov 14 17:50:26 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:50:26</nova:creationTime>
Nov 14 17:50:26 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:50:26 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:50:26 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:50:26 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:50:26 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:50:26 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:50:26 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:50:26 user nova-compute[76161]:       <nova:owner>
Nov 14 17:50:26 user nova-compute[76161]:         <nova:user uuid="470be45a97bd464b9d22b2fb6f97cf95">tempest-VolumesSnapshotTestJSON-688447987-project-member</nova:user>
Nov 14 17:50:26 user nova-compute[76161]:         <nova:project uuid="ec9d6960a8574bf5879639b40b156a86">tempest-VolumesSnapshotTestJSON-688447987</nova:project>
Nov 14 17:50:26 user nova-compute[76161]:       </nova:owner>
Nov 14 17:50:26 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:50:26 user nova-compute[76161]:       <nova:ports>
Nov 14 17:50:26 user nova-compute[76161]:         <nova:port uuid="9e624cc1-9ddd-4a4d-924d-1aecdcc84c90">
Nov 14 17:50:26 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 17:50:26 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:26 user nova-compute[76161]:       </nova:ports>
Nov 14 17:50:26 user nova-compute[76161]:     </nova:instance>
Nov 14 17:50:26 user nova-compute[76161]:   </metadata>
Nov 14 17:50:26 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:50:26 user nova-compute[76161]:     <system>
Nov 14 17:50:26 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:50:26 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:50:26 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:50:26 user nova-compute[76161]:       <entry name="serial">2ade3f5e-24a0-4989-854a-f4a90e5cf30a</entry>
Nov 14 17:50:26 user nova-compute[76161]:       <entry name="uuid">2ade3f5e-24a0-4989-854a-f4a90e5cf30a</entry>
Nov 14 17:50:26 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:50:26 user nova-compute[76161]:     </system>
Nov 14 17:50:26 user nova-compute[76161]:   </sysinfo>
Nov 14 17:50:26 user nova-compute[76161]:   <os>
Nov 14 17:50:26 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:50:26 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:50:26 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:50:26 user nova-compute[76161]:   </os>
Nov 14 17:50:26 user nova-compute[76161]:   <features>
Nov 14 17:50:26 user nova-compute[76161]:     <acpi/>
Nov 14 17:50:26 user nova-compute[76161]:     <apic/>
Nov 14 17:50:26 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:50:26 user nova-compute[76161]:   </features>
Nov 14 17:50:26 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:50:26 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:50:26 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:50:26 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:50:26 user nova-compute[76161]:   </clock>
Nov 14 17:50:26 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:50:26 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:50:26 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:50:26 user nova-compute[76161]:   </cpu>
Nov 14 17:50:26 user nova-compute[76161]:   <devices>
Nov 14 17:50:26 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:50:26 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:50:26 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk"/>
Nov 14 17:50:26 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:50:26 user nova-compute[76161]:     </disk>
Nov 14 17:50:26 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:26 user nova-compute[76161]:       <mac address="fa:16:3e:bc:45:3d"/>
Nov 14 17:50:26 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:26 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:26 user nova-compute[76161]:       <target dev="tap9e624cc1-9d"/>
Nov 14 17:50:26 user nova-compute[76161]:     </interface>
Nov 14 17:50:26 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:50:26 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/console.log" append="off"/>
Nov 14 17:50:26 user nova-compute[76161]:     </serial>
Nov 14 17:50:26 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:50:26 user nova-compute[76161]:     <video>
Nov 14 17:50:26 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:26 user nova-compute[76161]:     </video>
Nov 14 17:50:26 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:50:26 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:50:26 user nova-compute[76161]:     </rng>
Nov 14 17:50:26 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:50:26 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:50:26 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:50:26 user nova-compute[76161]:     </memballoon>
Nov 14 17:50:26 user nova-compute[76161]:   </devices>
Nov 14 17:50:26 user nova-compute[76161]: </domain>
Nov 14 17:50:26 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1060209255',display_name='tempest-VolumesSnapshotTestJSON-instance-1060209255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1060209255',id=12,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIa9deK2vCKuisnbPqZ1BnyqGrG3V2AjClocao4NNpRJ9L0536oPP/E+r2m64tptl5uHSbwUYjo16AStNDNXZPVv65RDeRKyfgEbjfT06Mr4DR576OWHFszqSS7LLxU3A==',key_name='tempest-keypair-1362659200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec9d6960a8574bf5879639b40b156a86',ramdisk_id='',reservation_id='r-iimck8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-688447987',owner_user_name='tempest-VolumesSnapshotTestJSON-688447987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='470be45a97bd464b9d22b2fb6f97cf95',uuid=2ade3f5e-24a0-4989-854a-f4a90e5cf30a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converting VIF {"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=9e624cc1-9ddd-4a4d-924d-1aecdcc84c90,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e624cc1-9d') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_vif [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=9e624cc1-9ddd-4a4d-924d-1aecdcc84c90,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e624cc1-9d') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '957657c7-08a2-568d-bc61-5b450bae98d2', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e624cc1-9d, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e624cc1-9d, col_values=(('qos', UUID('b587f98b-f30d-4aee-9b82-9fdba520a9d0')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e624cc1-9d, col_values=(('external_ids', {'iface-id': '9e624cc1-9ddd-4a4d-924d-1aecdcc84c90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:45:3d', 'vm-uuid': '2ade3f5e-24a0-4989-854a-f4a90e5cf30a'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:26 user nova-compute[76161]: INFO os_vif [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=9e624cc1-9ddd-4a4d-924d-1aecdcc84c90,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e624cc1-9d')
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] No VIF found with MAC fa:16:3e:bc:45:3d, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] <== connect_volume: return (1875ms) {'type': 'block', 'scsi_wwn': '23332396334353933', 'path': '/dev/sdd'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332396334353933', 'path': '/dev/sdd'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.384s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:26 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:26 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb122670-f0c1-4372-9105-671b19924330]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:50:26 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrxhpytl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:26 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a445727d-71bf-48aa-bb0e-83a9ef18925a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f] added
Nov 14 17:50:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[853725ad-d8b1-4246-94fa-11d10d3414ab]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[64432ad9-1278-4e4a-8501-8f810d3b2839]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPSeCwAa {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPSeCwAa" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[227c4b7e-13b0-48a6-ad68-89528c7c1ffa]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qPSeCwAa'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-1f77b0e1-cd1b-4611-a235-3084f4d9db57 req-44b9c20d-9ab9-4e6d-8c51-2cd68f6a9d33 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Updated VIF entry in instance network info cache for port 9e624cc1-9ddd-4a4d-924d-1aecdcc84c90. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-1f77b0e1-cd1b-4611-a235-3084f4d9db57 req-44b9c20d-9ab9-4e6d-8c51-2cd68f6a9d33 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Updating instance_info_cache with network_info: [{"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4def39-6529-45a5-8e45-2cc91aaa4ae7]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f77b0e1-cd1b-4611-a235-3084f4d9db57 req-44b9c20d-9ab9-4e6d-8c51-2cd68f6a9d33 service nova] Releasing lock "refresh_cache-2ade3f5e-24a0-4989-854a-f4a90e5cf30a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a32a4a8-fc76-421b-ad3c-f950b42a8ba0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:26 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:26 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:26 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:26 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[074ec1df-992e-4cf7-b15e-4d52d7997585]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f, portal: 172.16.0.220,3260]
Nov 14 17:50:26 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f, portal: 172.16.0.220,3260] successful.
Nov 14 17:50:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ff89e6-53d1-4afe-aa6a-c6e321de0875]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab5c838-3e68-49b9-90f2-41cda2679381]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:26 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:26 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:26 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:26 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:26 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:26 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[571da91b-a9d7-4fe5-aff5-acf75ab585f4]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:50:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPSeCwAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] <== connect_volume: return (2715ms) {'type': 'block', 'scsi_wwn': '26265643737393030', 'path': '/dev/sde'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265643737393030', 'path': '/dev/sde'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.295s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:27 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:27 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1c2d0b-bed2-4324-860a-6a5611c99a0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:50:27 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKUCubJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:27 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[85064bd4-221a-4e2b-98c6-818e14e9b627]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b] added
Nov 14 17:50:27 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[049651b3-ac9b-4b28-93d9-c0009a7d2be6]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-99a7d37e-7cf1-4268-a6be-1c54df1f82aa req-32831265-c126-4410-8b4a-448f5bf03c21 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received event network-vif-plugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-99a7d37e-7cf1-4268-a6be-1c54df1f82aa req-32831265-c126-4410-8b4a-448f5bf03c21 service nova] Acquiring lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-99a7d37e-7cf1-4268-a6be-1c54df1f82aa req-32831265-c126-4410-8b4a-448f5bf03c21 service nova] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-99a7d37e-7cf1-4268-a6be-1c54df1f82aa req-32831265-c126-4410-8b4a-448f5bf03c21 service nova] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-99a7d37e-7cf1-4268-a6be-1c54df1f82aa req-32831265-c126-4410-8b4a-448f5bf03c21 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] No waiting events found dispatching network-vif-plugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:27 user nova-compute[76161]: WARNING nova.compute.manager [req-99a7d37e-7cf1-4268-a6be-1c54df1f82aa req-32831265-c126-4410-8b4a-448f5bf03c21 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received unexpected event network-vif-plugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 for instance with vm_state building and task_state spawning.
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53870e1-5c31-4fc5-bb43-13b2cece2fb0]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrxhpytl {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrxhpytl" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ea08f1-7802-49d9-8793-bd3039958ee3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jrxhpytl'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa4a506-fa08-48de-9b7c-90faa806f73a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f0129c-99ec-4d51-9bf1-87f513766534]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:27 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:27 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:27 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:27 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:27 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:27 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:27 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:27 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae395d17-975e-413f-9c43-77aabfd84c6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b, portal: 172.16.0.220,3260]
Nov 14 17:50:27 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b, portal: 172.16.0.220,3260] successful.
Nov 14 17:50:27 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[87886da0-d91b-4003-b1f5-d3e5fd5ef925]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f2cb30-cecf-4dc4-873a-6ce1ec44c90e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:28 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:28 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:28 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:28 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:50:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:28 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:28 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:28 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:28 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:50:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.038s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea8f2ee-a245-4073-9cf0-6c21b740f079]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrxhpytl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] <== connect_volume: return (2673ms) {'type': 'block', 'scsi_wwn': '23363643762656136', 'path': '/dev/sdf'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363643762656136', 'path': '/dev/sdf'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.329s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:29 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:29 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13582ff-17f4-488e-9b0d-519d602786cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:50:29 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqWbZGgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:50:29 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c37e9d-0edb-4801-9a1d-4e9d8197a6e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108] added
Nov 14 17:50:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f599e78-2429-43c4-867a-584ce222850d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca1e7d2-8ff9-413d-af37-7d7db4408c1a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKUCubJG {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iKUCubJG" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5750089e-cf56-4d58-a20e-a42481bb79be]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iKUCubJG'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63495dc-0920-414d-9ebe-ac823f253297]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0854a363-7764-47bc-8294-095f028466dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:50:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:50:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b1d989-1197-4afe-88bb-7df1bb132a8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108, portal: 172.16.0.220,3260]
Nov 14 17:50:29 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108, portal: 172.16.0.220,3260] successful.
Nov 14 17:50:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[32abc5b9-61e8-44f5-83de-4fecea6fb189]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f02950b-2803-46b2-a754-9558a9903f1f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:50:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:50:29 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:50:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda6d2f8-ca4a-47a9-b1e3-d137a5d9bf14]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKUCubJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:50:29 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Instance spawned successfully.
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:29 user nova-compute[76161]: INFO nova.compute.manager [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-1262d93e-3645-403d-bcc2-9aa41df36c22 req-ed4a7894-7a0a-42c6-848e-7282c99c4a09 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received event network-vif-plugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1262d93e-3645-403d-bcc2-9aa41df36c22 req-ed4a7894-7a0a-42c6-848e-7282c99c4a09 service nova] Acquiring lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1262d93e-3645-403d-bcc2-9aa41df36c22 req-ed4a7894-7a0a-42c6-848e-7282c99c4a09 service nova] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1262d93e-3645-403d-bcc2-9aa41df36c22 req-ed4a7894-7a0a-42c6-848e-7282c99c4a09 service nova] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-1262d93e-3645-403d-bcc2-9aa41df36c22 req-ed4a7894-7a0a-42c6-848e-7282c99c4a09 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] No waiting events found dispatching network-vif-plugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:29 user nova-compute[76161]: WARNING nova.compute.manager [req-1262d93e-3645-403d-bcc2-9aa41df36c22 req-ed4a7894-7a0a-42c6-848e-7282c99c4a09 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received unexpected event network-vif-plugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 for instance with vm_state building and task_state spawning.
Nov 14 17:50:29 user nova-compute[76161]: INFO nova.compute.manager [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Took 6.57 seconds to build instance.
Nov 14 17:50:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e2aaff2a-799e-4c42-8d4b-07f8fa941ea4 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.683s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] <== connect_volume: return (2656ms) {'type': 'block', 'scsi_wwn': '26362393633363261', 'path': '/dev/sdg'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362393633363261', 'path': '/dev/sdg'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.301s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:30 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:50:30 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0825c9-a6d1-4247-928b-e66172f2c687]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:50:30 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f5:88,bridge_name='br-int',has_traffic_filtering=True,id=dc4feb84-e8d8-471c-b343-9cc484201a86,network=Network(c533480a-7189-4c46-8ac1-fe59af3ad0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4feb84-e8') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=497ff416-9e25-4b65-915b-46b01d17e41f,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497ff416-9e') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e6:90,bridge_name='br-int',has_traffic_filtering=True,id=359d13b0-99ca-481b-a09e-f1d54046f9c8,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap359d13b0-99') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=ff41f832-98a2-4858-9afc-b6df0c638ed7,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff41f832-98') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c3:b5,bridge_name='br-int',has_traffic_filtering=True,id=e235037a-3ce6-4f04-a2f1-8e02958c47b9,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape235037a-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:68:df,bridge_name='br-int',has_traffic_filtering=True,id=11a6406d-86f0-4ef2-8541-60f6ae8e5cef,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6406d-86') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:c2,bridge_name='br-int',has_traffic_filtering=True,id=be8ed683-01f8-4816-a455-02a3e65a580e,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ed683-01') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.objects.instance [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lazy-loading 'pci_devices' on Instance uuid bc0af785-ac5b-4103-97e2-83285d9154da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4203f74c-86bc-4a64-b4f4-58abb93a7d53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3] added
Nov 14 17:50:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:50:30 user nova-compute[76161]:   <uuid>bc0af785-ac5b-4103-97e2-83285d9154da</uuid>
Nov 14 17:50:30 user nova-compute[76161]:   <name>instance-0000000a</name>
Nov 14 17:50:30 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:50:30 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:50:30 user nova-compute[76161]:   <metadata>
Nov 14 17:50:30 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:50:30 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:50:30 user nova-compute[76161]:       <nova:name>tempest-device-tagging-server-304144437</nova:name>
Nov 14 17:50:30 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:50:23</nova:creationTime>
Nov 14 17:50:30 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:50:30 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:50:30 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:50:30 user nova-compute[76161]:       <nova:owner>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:user uuid="659819be1e544005b018b937d23fa6e9">tempest-TaggedBootDevicesTest_v242-298283046-project-member</nova:user>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:project uuid="69a701f0dab64fc68396669c7ac14f9c">tempest-TaggedBootDevicesTest_v242-298283046</nova:project>
Nov 14 17:50:30 user nova-compute[76161]:       </nova:owner>
Nov 14 17:50:30 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:50:30 user nova-compute[76161]:       <nova:ports>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:port uuid="dc4feb84-e8d8-471c-b343-9cc484201a86">
Nov 14 17:50:30 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 17:50:30 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:port uuid="497ff416-9e25-4b65-915b-46b01d17e41f">
Nov 14 17:50:30 user nova-compute[76161]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Nov 14 17:50:30 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:port uuid="359d13b0-99ca-481b-a09e-f1d54046f9c8">
Nov 14 17:50:30 user nova-compute[76161]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Nov 14 17:50:30 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:port uuid="ff41f832-98a2-4858-9afc-b6df0c638ed7">
Nov 14 17:50:30 user nova-compute[76161]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Nov 14 17:50:30 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:port uuid="e235037a-3ce6-4f04-a2f1-8e02958c47b9">
Nov 14 17:50:30 user nova-compute[76161]:           <nova:ip type="fixed" address="10.1.1.220" ipVersion="4"/>
Nov 14 17:50:30 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:port uuid="11a6406d-86f0-4ef2-8541-60f6ae8e5cef">
Nov 14 17:50:30 user nova-compute[76161]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 17:50:30 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:30 user nova-compute[76161]:         <nova:port uuid="be8ed683-01f8-4816-a455-02a3e65a580e">
Nov 14 17:50:30 user nova-compute[76161]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 17:50:30 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:30 user nova-compute[76161]:       </nova:ports>
Nov 14 17:50:30 user nova-compute[76161]:     </nova:instance>
Nov 14 17:50:30 user nova-compute[76161]:   </metadata>
Nov 14 17:50:30 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:50:30 user nova-compute[76161]:     <system>
Nov 14 17:50:30 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:50:30 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:50:30 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:50:30 user nova-compute[76161]:       <entry name="serial">bc0af785-ac5b-4103-97e2-83285d9154da</entry>
Nov 14 17:50:30 user nova-compute[76161]:       <entry name="uuid">bc0af785-ac5b-4103-97e2-83285d9154da</entry>
Nov 14 17:50:30 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:50:30 user nova-compute[76161]:     </system>
Nov 14 17:50:30 user nova-compute[76161]:   </sysinfo>
Nov 14 17:50:30 user nova-compute[76161]:   <os>
Nov 14 17:50:30 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:50:30 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:50:30 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:50:30 user nova-compute[76161]:   </os>
Nov 14 17:50:30 user nova-compute[76161]:   <features>
Nov 14 17:50:30 user nova-compute[76161]:     <acpi/>
Nov 14 17:50:30 user nova-compute[76161]:     <apic/>
Nov 14 17:50:30 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:50:30 user nova-compute[76161]:   </features>
Nov 14 17:50:30 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:50:30 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:50:30 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:50:30 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:50:30 user nova-compute[76161]:   </clock>
Nov 14 17:50:30 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:50:30 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:50:30 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:50:30 user nova-compute[76161]:   </cpu>
Nov 14 17:50:30 user nova-compute[76161]:   <devices>
Nov 14 17:50:30 user nova-compute[76161]:     <disk type="file" device="cdrom">
Nov 14 17:50:30 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 17:50:30 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/bc0af785-ac5b-4103-97e2-83285d9154da/disk.config"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="hda" bus="ide"/>
Nov 14 17:50:30 user nova-compute[76161]:     </disk>
Nov 14 17:50:30 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:50:30 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:50:30 user nova-compute[76161]:       <source dev="/dev/sdc"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:       <serial>dfcdf194-0478-45fa-8da0-9a1aa69238f8</serial>
Nov 14 17:50:30 user nova-compute[76161]:     </disk>
Nov 14 17:50:30 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:50:30 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:50:30 user nova-compute[76161]:       <source dev="/dev/sde"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:       <serial>d59719bd-db14-446f-8481-c70f6f2acb2f</serial>
Nov 14 17:50:30 user nova-compute[76161]:     </disk>
Nov 14 17:50:30 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:50:30 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:50:30 user nova-compute[76161]:       <source dev="/dev/sdg"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="vdc" bus="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:       <serial>4b10766f-5218-4d44-b0ed-153e34460108</serial>
Nov 14 17:50:30 user nova-compute[76161]:     </disk>
Nov 14 17:50:30 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:30 user nova-compute[76161]:       <mac address="fa:16:3e:0d:f5:88"/>
Nov 14 17:50:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="tapdc4feb84-e8"/>
Nov 14 17:50:30 user nova-compute[76161]:     </interface>
Nov 14 17:50:30 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:30 user nova-compute[76161]:       <mac address="fa:16:3e:06:13:ba"/>
Nov 14 17:50:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="tap497ff416-9e"/>
Nov 14 17:50:30 user nova-compute[76161]:     </interface>
Nov 14 17:50:30 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:30 user nova-compute[76161]:       <mac address="fa:16:3e:ee:e6:90"/>
Nov 14 17:50:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="tap359d13b0-99"/>
Nov 14 17:50:30 user nova-compute[76161]:     </interface>
Nov 14 17:50:30 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:30 user nova-compute[76161]:       <mac address="fa:16:3e:8b:ce:c4"/>
Nov 14 17:50:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="tapff41f832-98"/>
Nov 14 17:50:30 user nova-compute[76161]:     </interface>
Nov 14 17:50:30 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:30 user nova-compute[76161]:       <mac address="fa:16:3e:16:c3:b5"/>
Nov 14 17:50:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="tape235037a-3c"/>
Nov 14 17:50:30 user nova-compute[76161]:     </interface>
Nov 14 17:50:30 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:30 user nova-compute[76161]:       <mac address="fa:16:3e:4e:68:df"/>
Nov 14 17:50:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="tap11a6406d-86"/>
Nov 14 17:50:30 user nova-compute[76161]:     </interface>
Nov 14 17:50:30 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:30 user nova-compute[76161]:       <mac address="fa:16:3e:2d:df:c2"/>
Nov 14 17:50:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:30 user nova-compute[76161]:       <target dev="tapbe8ed683-01"/>
Nov 14 17:50:30 user nova-compute[76161]:     </interface>
Nov 14 17:50:30 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:50:30 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/bc0af785-ac5b-4103-97e2-83285d9154da/console.log" append="off"/>
Nov 14 17:50:30 user nova-compute[76161]:     </serial>
Nov 14 17:50:30 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:50:30 user nova-compute[76161]:     <video>
Nov 14 17:50:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:30 user nova-compute[76161]:     </video>
Nov 14 17:50:30 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:50:30 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:50:30 user nova-compute[76161]:     </rng>
Nov 14 17:50:30 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:50:30 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:50:30 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:50:30 user nova-compute[76161]:     </memballoon>
Nov 14 17:50:30 user nova-compute[76161]:   </devices>
Nov 14 17:50:30 user nova-compute[76161]: </domain>
Nov 14 17:50:30 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f5:88,bridge_name='br-int',has_traffic_filtering=True,id=dc4feb84-e8d8-471c-b343-9cc484201a86,network=Network(c533480a-7189-4c46-8ac1-fe59af3ad0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4feb84-e8') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f5:88,bridge_name='br-int',has_traffic_filtering=True,id=dc4feb84-e8d8-471c-b343-9cc484201a86,network=Network(c533480a-7189-4c46-8ac1-fe59af3ad0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4feb84-e8') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb3653f4-aaf3-5bb1-893a-37e7242d99e4', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4b0410-f1a2-4655-b89b-86a264266f7a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc4feb84-e8, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc4feb84-e8, col_values=(('qos', UUID('c789f418-c26c-4d4b-a555-0b974c98299f')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc4feb84-e8, col_values=(('external_ids', {'iface-id': 'dc4feb84-e8d8-471c-b343-9cc484201a86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:f5:88', 'vm-uuid': 'bc0af785-ac5b-4103-97e2-83285d9154da'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c29b06-21bd-4e69-bb65-19b27870fb25]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqWbZGgB {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: INFO os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f5:88,bridge_name='br-int',has_traffic_filtering=True,id=dc4feb84-e8d8-471c-b343-9cc484201a86,network=Network(c533480a-7189-4c46-8ac1-fe59af3ad0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4feb84-e8')
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=497ff416-9e25-4b65-915b-46b01d17e41f,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497ff416-9e') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=497ff416-9e25-4b65-915b-46b01d17e41f,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497ff416-9e') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17fba103-d101-54c2-a204-d063ca69e191', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqWbZGgB" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3bf1c6-09d7-4bc0-8796-aaaeee0f90af]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jqWbZGgB'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap497ff416-9e, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap497ff416-9e, col_values=(('qos', UUID('0b9e1693-e9fa-47c3-b467-3ead66d65ab4')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap497ff416-9e, col_values=(('external_ids', {'iface-id': '497ff416-9e25-4b65-915b-46b01d17e41f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:13:ba', 'vm-uuid': 'bc0af785-ac5b-4103-97e2-83285d9154da'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaeb87b-0dc9-4904-9401-d63ad528f1a9]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: INFO os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=497ff416-9e25-4b65-915b-46b01d17e41f,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497ff416-9e')
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e6:90,bridge_name='br-int',has_traffic_filtering=True,id=359d13b0-99ca-481b-a09e-f1d54046f9c8,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap359d13b0-99') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e6:90,bridge_name='br-int',has_traffic_filtering=True,id=359d13b0-99ca-481b-a09e-f1d54046f9c8,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap359d13b0-99') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c51f5568-47a6-5cfe-8cde-126b6022ca0a', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9064a03-7d5b-4771-afe8-8d0d23200aa3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:50:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:50:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap359d13b0-99, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap359d13b0-99, col_values=(('qos', UUID('b4a80399-485c-4d3a-8886-cd4b53f780e1')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap359d13b0-99, col_values=(('external_ids', {'iface-id': '359d13b0-99ca-481b-a09e-f1d54046f9c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:e6:90', 'vm-uuid': 'bc0af785-ac5b-4103-97e2-83285d9154da'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: INFO os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e6:90,bridge_name='br-int',has_traffic_filtering=True,id=359d13b0-99ca-481b-a09e-f1d54046f9c8,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap359d13b0-99')
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=ff41f832-98a2-4858-9afc-b6df0c638ed7,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff41f832-98') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=ff41f832-98a2-4858-9afc-b6df0c638ed7,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff41f832-98') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa3c4d6c-1928-5617-a507-faf005af6190', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[39496e03-89b2-47c2-873a-8c52a20b97c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3, portal: 172.16.0.220,3260]
Nov 14 17:50:30 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3, portal: 172.16.0.220,3260] successful.
Nov 14 17:50:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff41f832-98, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff41f832-98, col_values=(('qos', UUID('a1ce16e9-aef1-4c8e-85b8-399f8cdd2546')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff41f832-98, col_values=(('external_ids', {'iface-id': 'ff41f832-98a2-4858-9afc-b6df0c638ed7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:ce:c4', 'vm-uuid': 'bc0af785-ac5b-4103-97e2-83285d9154da'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0e0405-4f65-4599-9c12-b39db0686946]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: INFO os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=ff41f832-98a2-4858-9afc-b6df0c638ed7,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff41f832-98')
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c3:b5,bridge_name='br-int',has_traffic_filtering=True,id=e235037a-3ce6-4f04-a2f1-8e02958c47b9,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape235037a-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c3:b5,bridge_name='br-int',has_traffic_filtering=True,id=e235037a-3ce6-4f04-a2f1-8e02958c47b9,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape235037a-3c') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c2a4d0-c94a-4321-80a6-a123131b2b28]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:50:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:50:30 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:50:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd94cc235-3824-5f29-a1e2-ada954511c4a', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f738592-541b-4859-8fc7-051848110f52]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqWbZGgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape235037a-3c, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape235037a-3c, col_values=(('qos', UUID('27931cd2-7c70-410c-b199-e5db80c85ffb')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape235037a-3c, col_values=(('external_ids', {'iface-id': 'e235037a-3ce6-4f04-a2f1-8e02958c47b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:c3:b5', 'vm-uuid': 'bc0af785-ac5b-4103-97e2-83285d9154da'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: INFO os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c3:b5,bridge_name='br-int',has_traffic_filtering=True,id=e235037a-3ce6-4f04-a2f1-8e02958c47b9,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape235037a-3c')
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:68:df,bridge_name='br-int',has_traffic_filtering=True,id=11a6406d-86f0-4ef2-8541-60f6ae8e5cef,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6406d-86') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:68:df,bridge_name='br-int',has_traffic_filtering=True,id=11a6406d-86f0-4ef2-8541-60f6ae8e5cef,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6406d-86') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65483154-a09e-5c5d-aa1b-d18913fdb39e', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11a6406d-86, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11a6406d-86, col_values=(('qos', UUID('8bc344a6-c5bc-4b20-adde-3e12ca21e77d')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11a6406d-86, col_values=(('external_ids', {'iface-id': '11a6406d-86f0-4ef2-8541-60f6ae8e5cef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:68:df', 'vm-uuid': 'bc0af785-ac5b-4103-97e2-83285d9154da'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: INFO os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:68:df,bridge_name='br-int',has_traffic_filtering=True,id=11a6406d-86f0-4ef2-8541-60f6ae8e5cef,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6406d-86')
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:c2,bridge_name='br-int',has_traffic_filtering=True,id=be8ed683-01f8-4816-a455-02a3e65a580e,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ed683-01') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:c2,bridge_name='br-int',has_traffic_filtering=True,id=be8ed683-01f8-4816-a455-02a3e65a580e,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ed683-01') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86d146bf-b5a9-5d79-b8a7-eb72b51482cb', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe8ed683-01, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe8ed683-01, col_values=(('qos', UUID('a8f4fc8c-747e-424b-878a-dc1dd83804e3')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe8ed683-01, col_values=(('external_ids', {'iface-id': 'be8ed683-01f8-4816-a455-02a3e65a580e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:df:c2', 'vm-uuid': 'bc0af785-ac5b-4103-97e2-83285d9154da'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: INFO os_vif [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:c2,bridge_name='br-int',has_traffic_filtering=True,id=be8ed683-01f8-4816-a455-02a3e65a580e,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ed683-01')
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] No BDM found with device name hda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] No VIF found with MAC fa:16:3e:0d:f5:88, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] No VIF found with MAC fa:16:3e:16:c3:b5, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:50:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Using config drive
Nov 14 17:50:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Creating config drive at /opt/stack/data/nova/instances/bc0af785-ac5b-4103-97e2-83285d9154da/disk.config
Nov 14 17:50:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bc0af785-ac5b-4103-97e2-83285d9154da/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2fp47hxe {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bc0af785-ac5b-4103-97e2-83285d9154da/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2fp47hxe" returned: 0 in 0.053s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] <== connect_volume: return (2678ms) {'type': 'block', 'scsi_wwn': '26432313134363432', 'path': '/dev/sdh'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432313134363432', 'path': '/dev/sdh'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=72a8f902-4304-40a0-ae7f-308ddf7e4956,network=Network(4a15a63f-c3cd-429d-b64a-85872fd8bd00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a8f902-43') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:6d:c4,bridge_name='br-int',has_traffic_filtering=True,id=d6ff8d78-d459-4b93-9858-152428ce2cf9,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6ff8d78-d4') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:77:38,bridge_name='br-int',has_traffic_filtering=True,id=fbd5f82c-3c9c-4b63-807a-3af5841746a4,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbd5f82c-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:91:22,bridge_name='br-int',has_traffic_filtering=True,id=18f649cd-267b-41cf-a249-cec8fd1e6b4e,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f649cd-26') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:48:10,bridge_name='br-int',has_traffic_filtering=True,id=e13e7508-0ac3-419f-b854-fb081e44aa65,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13e7508-0a') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:b8,bridge_name='br-int',has_traffic_filtering=True,id=05b9f44c-73e6-40e5-afb5-96fd9a196210,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b9f44c-73') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:35:17,bridge_name='br-int',has_traffic_filtering=True,id=4ee1239f-391c-4006-af98-3beaffe581bc,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1239f-39') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lazy-loading 'pci_devices' on Instance uuid 11cabda6-8cc9-481f-b91c-5fd359e98515 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:50:31 user nova-compute[76161]:   <uuid>11cabda6-8cc9-481f-b91c-5fd359e98515</uuid>
Nov 14 17:50:31 user nova-compute[76161]:   <name>instance-0000000b</name>
Nov 14 17:50:31 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:50:31 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:50:31 user nova-compute[76161]:   <metadata>
Nov 14 17:50:31 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:50:31 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:50:31 user nova-compute[76161]:       <nova:name>tempest-device-tagging-server-1298780162</nova:name>
Nov 14 17:50:31 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:50:24</nova:creationTime>
Nov 14 17:50:31 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:50:31 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:50:31 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:50:31 user nova-compute[76161]:       <nova:owner>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:user uuid="f032554742874fd1b86a0a9019c4418c">tempest-TaggedBootDevicesTest-1442842885-project-member</nova:user>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:project uuid="db46f69a7d5c4578b58c89fd04bfe824">tempest-TaggedBootDevicesTest-1442842885</nova:project>
Nov 14 17:50:31 user nova-compute[76161]:       </nova:owner>
Nov 14 17:50:31 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:50:31 user nova-compute[76161]:       <nova:ports>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:port uuid="72a8f902-4304-40a0-ae7f-308ddf7e4956">
Nov 14 17:50:31 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 17:50:31 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:port uuid="d6ff8d78-d459-4b93-9858-152428ce2cf9">
Nov 14 17:50:31 user nova-compute[76161]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Nov 14 17:50:31 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:port uuid="fbd5f82c-3c9c-4b63-807a-3af5841746a4">
Nov 14 17:50:31 user nova-compute[76161]:           <nova:ip type="fixed" address="10.1.1.190" ipVersion="4"/>
Nov 14 17:50:31 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:port uuid="18f649cd-267b-41cf-a249-cec8fd1e6b4e">
Nov 14 17:50:31 user nova-compute[76161]:           <nova:ip type="fixed" address="10.1.1.123" ipVersion="4"/>
Nov 14 17:50:31 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:port uuid="e13e7508-0ac3-419f-b854-fb081e44aa65">
Nov 14 17:50:31 user nova-compute[76161]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Nov 14 17:50:31 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:port uuid="05b9f44c-73e6-40e5-afb5-96fd9a196210">
Nov 14 17:50:31 user nova-compute[76161]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 17:50:31 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:31 user nova-compute[76161]:         <nova:port uuid="4ee1239f-391c-4006-af98-3beaffe581bc">
Nov 14 17:50:31 user nova-compute[76161]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 17:50:31 user nova-compute[76161]:         </nova:port>
Nov 14 17:50:31 user nova-compute[76161]:       </nova:ports>
Nov 14 17:50:31 user nova-compute[76161]:     </nova:instance>
Nov 14 17:50:31 user nova-compute[76161]:   </metadata>
Nov 14 17:50:31 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:50:31 user nova-compute[76161]:     <system>
Nov 14 17:50:31 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:50:31 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:50:31 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:50:31 user nova-compute[76161]:       <entry name="serial">11cabda6-8cc9-481f-b91c-5fd359e98515</entry>
Nov 14 17:50:31 user nova-compute[76161]:       <entry name="uuid">11cabda6-8cc9-481f-b91c-5fd359e98515</entry>
Nov 14 17:50:31 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:50:31 user nova-compute[76161]:     </system>
Nov 14 17:50:31 user nova-compute[76161]:   </sysinfo>
Nov 14 17:50:31 user nova-compute[76161]:   <os>
Nov 14 17:50:31 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:50:31 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:50:31 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:50:31 user nova-compute[76161]:   </os>
Nov 14 17:50:31 user nova-compute[76161]:   <features>
Nov 14 17:50:31 user nova-compute[76161]:     <acpi/>
Nov 14 17:50:31 user nova-compute[76161]:     <apic/>
Nov 14 17:50:31 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:50:31 user nova-compute[76161]:   </features>
Nov 14 17:50:31 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:50:31 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:50:31 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:50:31 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:50:31 user nova-compute[76161]:   </clock>
Nov 14 17:50:31 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:50:31 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:50:31 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:50:31 user nova-compute[76161]:   </cpu>
Nov 14 17:50:31 user nova-compute[76161]:   <devices>
Nov 14 17:50:31 user nova-compute[76161]:     <disk type="file" device="cdrom">
Nov 14 17:50:31 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 17:50:31 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/11cabda6-8cc9-481f-b91c-5fd359e98515/disk.config"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="hda" bus="ide"/>
Nov 14 17:50:31 user nova-compute[76161]:     </disk>
Nov 14 17:50:31 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:50:31 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:50:31 user nova-compute[76161]:       <source dev="/dev/sdd"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:       <serial>a025f514-8a66-4a0a-a24f-f3023cb869ed</serial>
Nov 14 17:50:31 user nova-compute[76161]:     </disk>
Nov 14 17:50:31 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:50:31 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:50:31 user nova-compute[76161]:       <source dev="/dev/sdf"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:       <serial>6327b23e-67c0-46fe-9ce5-45f61c584d5b</serial>
Nov 14 17:50:31 user nova-compute[76161]:     </disk>
Nov 14 17:50:31 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:50:31 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:50:31 user nova-compute[76161]:       <source dev="/dev/sdh"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="vdc" bus="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:       <serial>d8f2c208-12e7-4583-ac16-15a172993fd3</serial>
Nov 14 17:50:31 user nova-compute[76161]:     </disk>
Nov 14 17:50:31 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:31 user nova-compute[76161]:       <mac address="fa:16:3e:c2:82:a8"/>
Nov 14 17:50:31 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="tap72a8f902-43"/>
Nov 14 17:50:31 user nova-compute[76161]:     </interface>
Nov 14 17:50:31 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:31 user nova-compute[76161]:       <mac address="fa:16:3e:d7:6d:c4"/>
Nov 14 17:50:31 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="tapd6ff8d78-d4"/>
Nov 14 17:50:31 user nova-compute[76161]:     </interface>
Nov 14 17:50:31 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:31 user nova-compute[76161]:       <mac address="fa:16:3e:1b:77:38"/>
Nov 14 17:50:31 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="tapfbd5f82c-3c"/>
Nov 14 17:50:31 user nova-compute[76161]:     </interface>
Nov 14 17:50:31 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:31 user nova-compute[76161]:       <mac address="fa:16:3e:ee:91:22"/>
Nov 14 17:50:31 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="tap18f649cd-26"/>
Nov 14 17:50:31 user nova-compute[76161]:     </interface>
Nov 14 17:50:31 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:31 user nova-compute[76161]:       <mac address="fa:16:3e:b9:48:10"/>
Nov 14 17:50:31 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="tape13e7508-0a"/>
Nov 14 17:50:31 user nova-compute[76161]:     </interface>
Nov 14 17:50:31 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:31 user nova-compute[76161]:       <mac address="fa:16:3e:1b:58:b8"/>
Nov 14 17:50:31 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="tap05b9f44c-73"/>
Nov 14 17:50:31 user nova-compute[76161]:     </interface>
Nov 14 17:50:31 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:50:31 user nova-compute[76161]:       <mac address="fa:16:3e:ae:35:17"/>
Nov 14 17:50:31 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:50:31 user nova-compute[76161]:       <target dev="tap4ee1239f-39"/>
Nov 14 17:50:31 user nova-compute[76161]:     </interface>
Nov 14 17:50:31 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:50:31 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/11cabda6-8cc9-481f-b91c-5fd359e98515/console.log" append="off"/>
Nov 14 17:50:31 user nova-compute[76161]:     </serial>
Nov 14 17:50:31 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:50:31 user nova-compute[76161]:     <video>
Nov 14 17:50:31 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:50:31 user nova-compute[76161]:     </video>
Nov 14 17:50:31 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:50:31 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:50:31 user nova-compute[76161]:     </rng>
Nov 14 17:50:31 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:50:31 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:50:31 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:50:31 user nova-compute[76161]:     </memballoon>
Nov 14 17:50:31 user nova-compute[76161]:   </devices>
Nov 14 17:50:31 user nova-compute[76161]: </domain>
Nov 14 17:50:31 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=72a8f902-4304-40a0-ae7f-308ddf7e4956,network=Network(4a15a63f-c3cd-429d-b64a-85872fd8bd00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a8f902-43') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=72a8f902-4304-40a0-ae7f-308ddf7e4956,network=Network(4a15a63f-c3cd-429d-b64a-85872fd8bd00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a8f902-43') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04224d7b-bfe5-5578-bc8e-0ebf22ec708d', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72a8f902-43, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72a8f902-43, col_values=(('qos', UUID('1fb8eb6d-d247-495a-815f-c6abd4c95fda')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72a8f902-43, col_values=(('external_ids', {'iface-id': '72a8f902-4304-40a0-ae7f-308ddf7e4956', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:82:a8', 'vm-uuid': '11cabda6-8cc9-481f-b91c-5fd359e98515'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: INFO os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=72a8f902-4304-40a0-ae7f-308ddf7e4956,network=Network(4a15a63f-c3cd-429d-b64a-85872fd8bd00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a8f902-43')
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:6d:c4,bridge_name='br-int',has_traffic_filtering=True,id=d6ff8d78-d459-4b93-9858-152428ce2cf9,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6ff8d78-d4') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:6d:c4,bridge_name='br-int',has_traffic_filtering=True,id=d6ff8d78-d459-4b93-9858-152428ce2cf9,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6ff8d78-d4') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '635f2fda-f684-50c4-bb8b-758b1dd96119', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6ff8d78-d4, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6ff8d78-d4, col_values=(('qos', UUID('a4be1b5e-8102-4bfe-b7fe-60a5a115e574')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6ff8d78-d4, col_values=(('external_ids', {'iface-id': 'd6ff8d78-d459-4b93-9858-152428ce2cf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:6d:c4', 'vm-uuid': '11cabda6-8cc9-481f-b91c-5fd359e98515'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: INFO os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:6d:c4,bridge_name='br-int',has_traffic_filtering=True,id=d6ff8d78-d459-4b93-9858-152428ce2cf9,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6ff8d78-d4')
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:77:38,bridge_name='br-int',has_traffic_filtering=True,id=fbd5f82c-3c9c-4b63-807a-3af5841746a4,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbd5f82c-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:77:38,bridge_name='br-int',has_traffic_filtering=True,id=fbd5f82c-3c9c-4b63-807a-3af5841746a4,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbd5f82c-3c') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58ee42ed-554f-58a5-a0b1-9c858988c208', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbd5f82c-3c, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbd5f82c-3c, col_values=(('qos', UUID('df4e3916-1054-48ec-85e1-8c280b9ea1da')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbd5f82c-3c, col_values=(('external_ids', {'iface-id': 'fbd5f82c-3c9c-4b63-807a-3af5841746a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:77:38', 'vm-uuid': '11cabda6-8cc9-481f-b91c-5fd359e98515'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: INFO os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:77:38,bridge_name='br-int',has_traffic_filtering=True,id=fbd5f82c-3c9c-4b63-807a-3af5841746a4,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbd5f82c-3c')
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:91:22,bridge_name='br-int',has_traffic_filtering=True,id=18f649cd-267b-41cf-a249-cec8fd1e6b4e,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f649cd-26') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:91:22,bridge_name='br-int',has_traffic_filtering=True,id=18f649cd-267b-41cf-a249-cec8fd1e6b4e,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f649cd-26') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94da44a2-66fa-57fd-b283-3306c259b369', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18f649cd-26, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18f649cd-26, col_values=(('qos', UUID('44968902-d57c-4579-902a-b5f47ba64d36')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18f649cd-26, col_values=(('external_ids', {'iface-id': '18f649cd-267b-41cf-a249-cec8fd1e6b4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:91:22', 'vm-uuid': '11cabda6-8cc9-481f-b91c-5fd359e98515'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: INFO os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:91:22,bridge_name='br-int',has_traffic_filtering=True,id=18f649cd-267b-41cf-a249-cec8fd1e6b4e,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f649cd-26')
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:48:10,bridge_name='br-int',has_traffic_filtering=True,id=e13e7508-0ac3-419f-b854-fb081e44aa65,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13e7508-0a') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:48:10,bridge_name='br-int',has_traffic_filtering=True,id=e13e7508-0ac3-419f-b854-fb081e44aa65,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13e7508-0a') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41b5f22a-a469-5824-885b-63ebcea96522', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape13e7508-0a, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape13e7508-0a, col_values=(('qos', UUID('fa1551fb-a2e1-46d3-bd77-eb6b738a5244')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape13e7508-0a, col_values=(('external_ids', {'iface-id': 'e13e7508-0ac3-419f-b854-fb081e44aa65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:48:10', 'vm-uuid': '11cabda6-8cc9-481f-b91c-5fd359e98515'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: INFO os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:48:10,bridge_name='br-int',has_traffic_filtering=True,id=e13e7508-0ac3-419f-b854-fb081e44aa65,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13e7508-0a')
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:b8,bridge_name='br-int',has_traffic_filtering=True,id=05b9f44c-73e6-40e5-afb5-96fd9a196210,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b9f44c-73') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:b8,bridge_name='br-int',has_traffic_filtering=True,id=05b9f44c-73e6-40e5-afb5-96fd9a196210,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b9f44c-73') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '371020a3-930f-5478-ae46-195e5b250052', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05b9f44c-73, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05b9f44c-73, col_values=(('qos', UUID('eef40709-b35b-4952-a46e-9137be98ebfa')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05b9f44c-73, col_values=(('external_ids', {'iface-id': '05b9f44c-73e6-40e5-afb5-96fd9a196210', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:58:b8', 'vm-uuid': '11cabda6-8cc9-481f-b91c-5fd359e98515'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: INFO os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:b8,bridge_name='br-int',has_traffic_filtering=True,id=05b9f44c-73e6-40e5-afb5-96fd9a196210,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b9f44c-73')
Nov 14 17:50:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:35:17,bridge_name='br-int',has_traffic_filtering=True,id=4ee1239f-391c-4006-af98-3beaffe581bc,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1239f-39') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:35:17,bridge_name='br-int',has_traffic_filtering=True,id=4ee1239f-391c-4006-af98-3beaffe581bc,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1239f-39') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22f6c656-5522-5ad6-b33a-d90143afbe1b', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-2249a83d-eb5e-44bf-8e1a-fcda1e30e830 req-5d0f3453-2f9b-44cf-a6af-bfae1cd3051e service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2249a83d-eb5e-44bf-8e1a-fcda1e30e830 req-5d0f3453-2f9b-44cf-a6af-bfae1cd3051e service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2249a83d-eb5e-44bf-8e1a-fcda1e30e830 req-5d0f3453-2f9b-44cf-a6af-bfae1cd3051e service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2249a83d-eb5e-44bf-8e1a-fcda1e30e830 req-5d0f3453-2f9b-44cf-a6af-bfae1cd3051e service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-2249a83d-eb5e-44bf-8e1a-fcda1e30e830 req-5d0f3453-2f9b-44cf-a6af-bfae1cd3051e service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:33 user nova-compute[76161]: WARNING nova.compute.manager [req-2249a83d-eb5e-44bf-8e1a-fcda1e30e830 req-5d0f3453-2f9b-44cf-a6af-bfae1cd3051e service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-dc4feb84-e8d8-471c-b343-9cc484201a86 for instance with vm_state building and task_state spawning.
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ee1239f-39, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ee1239f-39, col_values=(('qos', UUID('5a14cce3-2fb0-48e6-81d9-cdf69635f8f8')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ee1239f-39, col_values=(('external_ids', {'iface-id': '4ee1239f-391c-4006-af98-3beaffe581bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:35:17', 'vm-uuid': '11cabda6-8cc9-481f-b91c-5fd359e98515'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: INFO os_vif [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:35:17,bridge_name='br-int',has_traffic_filtering=True,id=4ee1239f-391c-4006-af98-3beaffe581bc,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1239f-39')
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] No BDM found with device name hda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] No VIF found with MAC fa:16:3e:c2:82:a8, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] No VIF found with MAC fa:16:3e:b9:48:10, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:50:33 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Using config drive
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-d0146b50-f57c-461e-9a23-a2da622c0f7d req-e457b205-7ee8-4a60-81cd-c6e371fee515 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0146b50-f57c-461e-9a23-a2da622c0f7d req-e457b205-7ee8-4a60-81cd-c6e371fee515 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0146b50-f57c-461e-9a23-a2da622c0f7d req-e457b205-7ee8-4a60-81cd-c6e371fee515 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0146b50-f57c-461e-9a23-a2da622c0f7d req-e457b205-7ee8-4a60-81cd-c6e371fee515 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-d0146b50-f57c-461e-9a23-a2da622c0f7d req-e457b205-7ee8-4a60-81cd-c6e371fee515 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:34 user nova-compute[76161]: WARNING nova.compute.manager [req-d0146b50-f57c-461e-9a23-a2da622c0f7d req-e457b205-7ee8-4a60-81cd-c6e371fee515 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 for instance with vm_state building and task_state spawning.
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Creating config drive at /opt/stack/data/nova/instances/11cabda6-8cc9-481f-b91c-5fd359e98515/disk.config
Nov 14 17:50:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11cabda6-8cc9-481f-b91c-5fd359e98515/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw26h99fg {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11cabda6-8cc9-481f-b91c-5fd359e98515/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw26h99fg" returned: 0 in 0.075s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:35 user nova-compute[76161]: WARNING nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-dc4feb84-e8d8-471c-b343-9cc484201a86 for instance with vm_state building and task_state spawning.
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:35 user nova-compute[76161]: WARNING nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-497ff416-9e25-4b65-915b-46b01d17e41f for instance with vm_state building and task_state spawning.
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:35 user nova-compute[76161]: WARNING nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-497ff416-9e25-4b65-915b-46b01d17e41f for instance with vm_state building and task_state spawning.
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:35 user nova-compute[76161]: WARNING nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 for instance with vm_state building and task_state spawning.
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:35 user nova-compute[76161]: WARNING nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 for instance with vm_state building and task_state spawning.
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:35 user nova-compute[76161]: WARNING nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 for instance with vm_state building and task_state spawning.
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:35 user nova-compute[76161]: WARNING nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 for instance with vm_state building and task_state spawning.
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:35 user nova-compute[76161]: WARNING nova.compute.manager [req-f66fd59e-e421-43a6-9786-f5885cb80042 req-ce6c8943-d4e7-44a9-a8fb-3df5aa4c49a9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef for instance with vm_state building and task_state spawning.
Nov 14 17:50:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG nova.compute.manager [req-e8ec41da-4859-48a0-b73f-4d6d8c5a8b8c req-a0d2a754-0706-42ab-8c20-271338fffe60 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e8ec41da-4859-48a0-b73f-4d6d8c5a8b8c req-a0d2a754-0706-42ab-8c20-271338fffe60 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e8ec41da-4859-48a0-b73f-4d6d8c5a8b8c req-a0d2a754-0706-42ab-8c20-271338fffe60 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e8ec41da-4859-48a0-b73f-4d6d8c5a8b8c req-a0d2a754-0706-42ab-8c20-271338fffe60 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG nova.compute.manager [req-e8ec41da-4859-48a0-b73f-4d6d8c5a8b8c req-a0d2a754-0706-42ab-8c20-271338fffe60 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:36 user nova-compute[76161]: WARNING nova.compute.manager [req-e8ec41da-4859-48a0-b73f-4d6d8c5a8b8c req-a0d2a754-0706-42ab-8c20-271338fffe60 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 for instance with vm_state building and task_state spawning.
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG nova.compute.manager [req-da71ca15-788e-42b7-83bb-9edf61f1d288 req-15202629-0275-497f-bd8e-6ff9b0f3741d service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-da71ca15-788e-42b7-83bb-9edf61f1d288 req-15202629-0275-497f-bd8e-6ff9b0f3741d service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-da71ca15-788e-42b7-83bb-9edf61f1d288 req-15202629-0275-497f-bd8e-6ff9b0f3741d service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-da71ca15-788e-42b7-83bb-9edf61f1d288 req-15202629-0275-497f-bd8e-6ff9b0f3741d service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:36 user nova-compute[76161]: DEBUG nova.compute.manager [req-da71ca15-788e-42b7-83bb-9edf61f1d288 req-15202629-0275-497f-bd8e-6ff9b0f3741d service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:36 user nova-compute[76161]: WARNING nova.compute.manager [req-da71ca15-788e-42b7-83bb-9edf61f1d288 req-15202629-0275-497f-bd8e-6ff9b0f3741d service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 for instance with vm_state building and task_state spawning.
Nov 14 17:50:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:37 user nova-compute[76161]: WARNING nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef for instance with vm_state building and task_state spawning.
Nov 14 17:50:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:37 user nova-compute[76161]: WARNING nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-be8ed683-01f8-4816-a455-02a3e65a580e for instance with vm_state building and task_state spawning.
Nov 14 17:50:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:37 user nova-compute[76161]: WARNING nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-be8ed683-01f8-4816-a455-02a3e65a580e for instance with vm_state building and task_state spawning.
Nov 14 17:50:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:37 user nova-compute[76161]: WARNING nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 for instance with vm_state building and task_state spawning.
Nov 14 17:50:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:37 user nova-compute[76161]: WARNING nova.compute.manager [req-2774961a-b377-4ee8-8a57-0f94aeded3d5 req-24c0c0d7-afe3-4c6f-9e53-840aff3fbe64 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 for instance with vm_state building and task_state spawning.
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:38 user nova-compute[76161]: WARNING nova.compute.manager [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 for instance with vm_state building and task_state spawning.
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:38 user nova-compute[76161]: WARNING nova.compute.manager [req-0cf13694-543e-4a7d-85ff-465c785968fb req-f95c646a-5155-4b41-a13e-f14dfbc58124 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 for instance with vm_state building and task_state spawning.
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:50:38 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Instance spawned successfully.
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:38 user nova-compute[76161]: INFO nova.compute.manager [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Took 15.42 seconds to spawn the instance on the hypervisor.
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:38 user nova-compute[76161]: WARNING nova.compute.manager [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 for instance with vm_state building and task_state spawning.
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:38 user nova-compute[76161]: WARNING nova.compute.manager [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-e13e7508-0ac3-419f-b854-fb081e44aa65 for instance with vm_state building and task_state spawning.
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:38 user nova-compute[76161]: WARNING nova.compute.manager [req-0ec93bf3-a60a-4435-9463-d66939fc293e req-618eefbf-7c7a-4035-a6b1-080c7f528979 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-e13e7508-0ac3-419f-b854-fb081e44aa65 for instance with vm_state building and task_state spawning.
Nov 14 17:50:39 user nova-compute[76161]: INFO nova.compute.manager [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Took 33.48 seconds to build instance.
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-baef70b3-e305-40a0-903d-3677ddea1aa9 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "bc0af785-ac5b-4103-97e2-83285d9154da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.648s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:39 user nova-compute[76161]: WARNING nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e for instance with vm_state building and task_state spawning.
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:39 user nova-compute[76161]: WARNING nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e for instance with vm_state building and task_state spawning.
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:39 user nova-compute[76161]: WARNING nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 for instance with vm_state building and task_state spawning.
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:39 user nova-compute[76161]: WARNING nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 for instance with vm_state building and task_state spawning.
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:39 user nova-compute[76161]: WARNING nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-4ee1239f-391c-4006-af98-3beaffe581bc for instance with vm_state building and task_state spawning.
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:50:39 user nova-compute[76161]: WARNING nova.compute.manager [req-59850508-6eb6-40cd-8de1-b5adae0c1d32 req-4d4ff47b-86f2-4567-8d7c-1ed4aea0ff4f service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-4ee1239f-391c-4006-af98-3beaffe581bc for instance with vm_state building and task_state spawning.
Nov 14 17:50:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:50:40 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Instance spawned successfully.
Nov 14 17:50:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:50:40 user nova-compute[76161]: INFO nova.compute.manager [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Took 16.53 seconds to spawn the instance on the hypervisor.
Nov 14 17:50:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:50:41 user nova-compute[76161]: INFO nova.compute.manager [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Took 34.56 seconds to build instance.
Nov 14 17:50:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5f6929b2-7e28-41c5-9d90-9049d8e5a201 tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.661s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:50:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:50:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:51:04 user nova-compute[76161]: INFO nova.compute.manager [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] instance snapshotting
Nov 14 17:51:04 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Beginning live snapshot process
Nov 14 17:51:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json -f qcow2 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json -f qcow2" returned: 0 in 0.612s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json -f qcow2 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj6tolb42/daab7ac1a27a4d9ea1d3482d621f96a0.delta 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj6tolb42/daab7ac1a27a4d9ea1d3482d621f96a0.delta 1073741824" returned: 0 in 0.050s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:05 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 17:51:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Checking UEFI support for host arch (x86_64) {{(pid=76161) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 17:51:05 user nova-compute[76161]: INFO nova.virt.libvirt.host [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] UEFI support detected
Nov 14 17:51:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:51:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:51:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:06 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:51:06 user nova-compute[76161]: INFO nova.compute.claims [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Claim successful on node user
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] COPY block job progress, current cursor: 12845056 final cursor: 75497472 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lazy-loading 'flavor' on Instance uuid f8c62b07-2d5b-4619-98ec-b77eb524829a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:07 user nova-compute[76161]: INFO nova.compute.manager [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Attaching volume 8a235387-b484-402a-9696-91c7aa3e8a00 to /dev/vdb
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.network.neutron [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:51:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG os_brick.utils [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3082633b-1757-4ed7-bc1d-bb30f5b8acaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d180e4-d009-4c79-8573-d8885413631d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.policy [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '983ee707e2eb4a2ba4617f91d810011d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68afcd8a90ba42bd860204d31efae7e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d100fc13-520b-4571-b8f0-864f9975d9a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c879daab-5f01-41ed-a0d8-2d3528c66b38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:51:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Creating image(s)
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "/opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "/opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "/opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:51:07 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[65887359-e14b-4ede-aa60-abd5c0cdf4b8]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG os_brick.utils [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Updating existing volume attachment record: 297d5f8a-d06b-4c9c-9f60-3615dc2f847a {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 17:51:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj6tolb42/daab7ac1a27a4d9ea1d3482d621f96a0.delta /opt/stack/data/nova/instances/snapshots/tmpj6tolb42/daab7ac1a27a4d9ea1d3482d621f96a0 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.407s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.198s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG nova.network.neutron [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Successfully created port: a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk 1073741824" returned: 0 in 0.085s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj6tolb42/daab7ac1a27a4d9ea1d3482d621f96a0.delta /opt/stack/data/nova/instances/snapshots/tmpj6tolb42/daab7ac1a27a4d9ea1d3482d621f96a0" returned: 0 in 0.702s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:08 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Snapshot extracted, beginning image upload
Nov 14 17:51:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Cannot resize image /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Ensure instance console log exists: /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Successfully updated port: a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "refresh_cache-55765bdd-d12d-4466-af2b-6912e5ae8f4e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquired lock "refresh_cache-55765bdd-d12d-4466-af2b-6912e5ae8f4e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-de223df7-c1cd-4bd5-b3df-07ff554aa8d2 req-e23350ea-8b60-4fa0-88d9-9e8e2c1d62d4 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Received event network-changed-a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-de223df7-c1cd-4bd5-b3df-07ff554aa8d2 req-e23350ea-8b60-4fa0-88d9-9e8e2c1d62d4 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Refreshing instance network info cache due to event network-changed-a654ff6e-44f7-4b7f-bc96-2347309fd33a. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-de223df7-c1cd-4bd5-b3df-07ff554aa8d2 req-e23350ea-8b60-4fa0-88d9-9e8e2c1d62d4 service nova] Acquiring lock "refresh_cache-55765bdd-d12d-4466-af2b-6912e5ae8f4e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Updating instance_info_cache with network_info: [{"id": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "address": "fa:16:3e:d8:6d:e9", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa654ff6e-44", "ovs_interfaceid": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Releasing lock "refresh_cache-55765bdd-d12d-4466-af2b-6912e5ae8f4e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.compute.manager [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Instance network_info: |[{"id": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "address": "fa:16:3e:d8:6d:e9", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa654ff6e-44", "ovs_interfaceid": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-de223df7-c1cd-4bd5-b3df-07ff554aa8d2 req-e23350ea-8b60-4fa0-88d9-9e8e2c1d62d4 service nova] Acquired lock "refresh_cache-55765bdd-d12d-4466-af2b-6912e5ae8f4e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.neutron [req-de223df7-c1cd-4bd5-b3df-07ff554aa8d2 req-e23350ea-8b60-4fa0-88d9-9e8e2c1d62d4 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Refreshing network info cache for port a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Start _get_guest_xml network_info=[{"id": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "address": "fa:16:3e:d8:6d:e9", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa654ff6e-44", "ovs_interfaceid": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:51:09 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:51:09 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-639261941',display_name='tempest-ServersNegativeTestJSON-server-639261941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-639261941',id=13,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68afcd8a90ba42bd860204d31efae7e0',ramdisk_id='',reservation_id='r-j3azbg0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1371271005',owner_user_name='tempest-ServersNegativeTestJSON-1371271005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:51:08Z,user_data=None,user_id='983ee707e2eb4a2ba4617f91d810011d',uuid=55765bdd-d12d-4466-af2b-6912e5ae8f4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "address": "fa:16:3e:d8:6d:e9", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa654ff6e-44", "ovs_interfaceid": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converting VIF {"id": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "address": "fa:16:3e:d8:6d:e9", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa654ff6e-44", "ovs_interfaceid": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6d:e9,bridge_name='br-int',has_traffic_filtering=True,id=a654ff6e-44f7-4b7f-bc96-2347309fd33a,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa654ff6e-44') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.objects.instance [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lazy-loading 'pci_devices' on Instance uuid 55765bdd-d12d-4466-af2b-6912e5ae8f4e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:51:09 user nova-compute[76161]:   <uuid>55765bdd-d12d-4466-af2b-6912e5ae8f4e</uuid>
Nov 14 17:51:09 user nova-compute[76161]:   <name>instance-0000000d</name>
Nov 14 17:51:09 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:51:09 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:51:09 user nova-compute[76161]:   <metadata>
Nov 14 17:51:09 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:51:09 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:51:09 user nova-compute[76161]:       <nova:name>tempest-ServersNegativeTestJSON-server-639261941</nova:name>
Nov 14 17:51:09 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:51:09</nova:creationTime>
Nov 14 17:51:09 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:51:09 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:51:09 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:51:09 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:51:09 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:51:09 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:51:09 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:51:09 user nova-compute[76161]:       <nova:owner>
Nov 14 17:51:09 user nova-compute[76161]:         <nova:user uuid="983ee707e2eb4a2ba4617f91d810011d">tempest-ServersNegativeTestJSON-1371271005-project-member</nova:user>
Nov 14 17:51:09 user nova-compute[76161]:         <nova:project uuid="68afcd8a90ba42bd860204d31efae7e0">tempest-ServersNegativeTestJSON-1371271005</nova:project>
Nov 14 17:51:09 user nova-compute[76161]:       </nova:owner>
Nov 14 17:51:09 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:51:09 user nova-compute[76161]:       <nova:ports>
Nov 14 17:51:09 user nova-compute[76161]:         <nova:port uuid="a654ff6e-44f7-4b7f-bc96-2347309fd33a">
Nov 14 17:51:09 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 17:51:09 user nova-compute[76161]:         </nova:port>
Nov 14 17:51:09 user nova-compute[76161]:       </nova:ports>
Nov 14 17:51:09 user nova-compute[76161]:     </nova:instance>
Nov 14 17:51:09 user nova-compute[76161]:   </metadata>
Nov 14 17:51:09 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:51:09 user nova-compute[76161]:     <system>
Nov 14 17:51:09 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:51:09 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:51:09 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:51:09 user nova-compute[76161]:       <entry name="serial">55765bdd-d12d-4466-af2b-6912e5ae8f4e</entry>
Nov 14 17:51:09 user nova-compute[76161]:       <entry name="uuid">55765bdd-d12d-4466-af2b-6912e5ae8f4e</entry>
Nov 14 17:51:09 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:51:09 user nova-compute[76161]:     </system>
Nov 14 17:51:09 user nova-compute[76161]:   </sysinfo>
Nov 14 17:51:09 user nova-compute[76161]:   <os>
Nov 14 17:51:09 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:51:09 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:51:09 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:51:09 user nova-compute[76161]:   </os>
Nov 14 17:51:09 user nova-compute[76161]:   <features>
Nov 14 17:51:09 user nova-compute[76161]:     <acpi/>
Nov 14 17:51:09 user nova-compute[76161]:     <apic/>
Nov 14 17:51:09 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:51:09 user nova-compute[76161]:   </features>
Nov 14 17:51:09 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:51:09 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:51:09 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:51:09 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:51:09 user nova-compute[76161]:   </clock>
Nov 14 17:51:09 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:51:09 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:51:09 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:51:09 user nova-compute[76161]:   </cpu>
Nov 14 17:51:09 user nova-compute[76161]:   <devices>
Nov 14 17:51:09 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:51:09 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:51:09 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk"/>
Nov 14 17:51:09 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:51:09 user nova-compute[76161]:     </disk>
Nov 14 17:51:09 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:51:09 user nova-compute[76161]:       <mac address="fa:16:3e:d8:6d:e9"/>
Nov 14 17:51:09 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:51:09 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:51:09 user nova-compute[76161]:       <target dev="tapa654ff6e-44"/>
Nov 14 17:51:09 user nova-compute[76161]:     </interface>
Nov 14 17:51:09 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:51:09 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/console.log" append="off"/>
Nov 14 17:51:09 user nova-compute[76161]:     </serial>
Nov 14 17:51:09 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:51:09 user nova-compute[76161]:     <video>
Nov 14 17:51:09 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:51:09 user nova-compute[76161]:     </video>
Nov 14 17:51:09 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:51:09 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:51:09 user nova-compute[76161]:     </rng>
Nov 14 17:51:09 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:51:09 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:51:09 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:51:09 user nova-compute[76161]:     </memballoon>
Nov 14 17:51:09 user nova-compute[76161]:   </devices>
Nov 14 17:51:09 user nova-compute[76161]: </domain>
Nov 14 17:51:09 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-639261941',display_name='tempest-ServersNegativeTestJSON-server-639261941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-639261941',id=13,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68afcd8a90ba42bd860204d31efae7e0',ramdisk_id='',reservation_id='r-j3azbg0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1371271005',owner_user_name='tempest-ServersNegativeTestJSON-1371271005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:51:08Z,user_data=None,user_id='983ee707e2eb4a2ba4617f91d810011d',uuid=55765bdd-d12d-4466-af2b-6912e5ae8f4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "address": "fa:16:3e:d8:6d:e9", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa654ff6e-44", "ovs_interfaceid": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converting VIF {"id": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "address": "fa:16:3e:d8:6d:e9", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa654ff6e-44", "ovs_interfaceid": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6d:e9,bridge_name='br-int',has_traffic_filtering=True,id=a654ff6e-44f7-4b7f-bc96-2347309fd33a,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa654ff6e-44') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG os_vif [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6d:e9,bridge_name='br-int',has_traffic_filtering=True,id=a654ff6e-44f7-4b7f-bc96-2347309fd33a,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa654ff6e-44') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad9f3fff-d6f1-5c27-a50d-1e97de87896a', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa654ff6e-44, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa654ff6e-44, col_values=(('qos', UUID('0078e1db-69c4-4fd4-babc-46bad6f22d41')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa654ff6e-44, col_values=(('external_ids', {'iface-id': 'a654ff6e-44f7-4b7f-bc96-2347309fd33a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:6d:e9', 'vm-uuid': '55765bdd-d12d-4466-af2b-6912e5ae8f4e'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:09 user nova-compute[76161]: INFO os_vif [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6d:e9,bridge_name='br-int',has_traffic_filtering=True,id=a654ff6e-44f7-4b7f-bc96-2347309fd33a,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa654ff6e-44')
Nov 14 17:51:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] No VIF found with MAC fa:16:3e:d8:6d:e9, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.neutron [req-de223df7-c1cd-4bd5-b3df-07ff554aa8d2 req-e23350ea-8b60-4fa0-88d9-9e8e2c1d62d4 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Updated VIF entry in instance network info cache for port a654ff6e-44f7-4b7f-bc96-2347309fd33a. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG nova.network.neutron [req-de223df7-c1cd-4bd5-b3df-07ff554aa8d2 req-e23350ea-8b60-4fa0-88d9-9e8e2c1d62d4 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Updating instance_info_cache with network_info: [{"id": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "address": "fa:16:3e:d8:6d:e9", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa654ff6e-44", "ovs_interfaceid": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-de223df7-c1cd-4bd5-b3df-07ff554aa8d2 req-e23350ea-8b60-4fa0-88d9-9e8e2c1d62d4 service nova] Releasing lock "refresh_cache-55765bdd-d12d-4466-af2b-6912e5ae8f4e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:10 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:51:10 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:51:10 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:51:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Snapshot image upload complete
Nov 14 17:51:11 user nova-compute[76161]: INFO nova.compute.manager [None req-652eb48a-891b-4ea3-ab99-25e0d1bd372e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Took 7.42 seconds to snapshot the instance on the hypervisor.
Nov 14 17:51:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-7a4f31f8-3652-4322-96dc-09dbc904e059 req-6a4dd2b3-9c6b-47ab-890f-905ee72904dd service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Received event network-vif-plugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7a4f31f8-3652-4322-96dc-09dbc904e059 req-6a4dd2b3-9c6b-47ab-890f-905ee72904dd service nova] Acquiring lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7a4f31f8-3652-4322-96dc-09dbc904e059 req-6a4dd2b3-9c6b-47ab-890f-905ee72904dd service nova] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7a4f31f8-3652-4322-96dc-09dbc904e059 req-6a4dd2b3-9c6b-47ab-890f-905ee72904dd service nova] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-7a4f31f8-3652-4322-96dc-09dbc904e059 req-6a4dd2b3-9c6b-47ab-890f-905ee72904dd service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] No waiting events found dispatching network-vif-plugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:51:11 user nova-compute[76161]: WARNING nova.compute.manager [req-7a4f31f8-3652-4322-96dc-09dbc904e059 req-6a4dd2b3-9c6b-47ab-890f-905ee72904dd service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Received unexpected event network-vif-plugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a for instance with vm_state building and task_state spawning.
Nov 14 17:51:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-60e5771a-8e19-483d-bc64-15eca1d39a09 req-2e1b9b9f-217f-466d-a0ec-90b2bd248665 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-changed-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-60e5771a-8e19-483d-bc64-15eca1d39a09 req-2e1b9b9f-217f-466d-a0ec-90b2bd248665 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Refreshing instance network info cache due to event network-changed-39b86458-3c6f-457f-b2ba-e2f4709ffb50. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-60e5771a-8e19-483d-bc64-15eca1d39a09 req-2e1b9b9f-217f-466d-a0ec-90b2bd248665 service nova] Acquiring lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-60e5771a-8e19-483d-bc64-15eca1d39a09 req-2e1b9b9f-217f-466d-a0ec-90b2bd248665 service nova] Acquired lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG nova.network.neutron [req-60e5771a-8e19-483d-bc64-15eca1d39a09 req-2e1b9b9f-217f-466d-a0ec-90b2bd248665 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Refreshing network info cache for port 39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Updating instance_info_cache with network_info: [{"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG nova.network.neutron [req-60e5771a-8e19-483d-bc64-15eca1d39a09 req-2e1b9b9f-217f-466d-a0ec-90b2bd248665 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updated VIF entry in instance network info cache for port 39b86458-3c6f-457f-b2ba-e2f4709ffb50. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG nova.network.neutron [req-60e5771a-8e19-483d-bc64-15eca1d39a09 req-2e1b9b9f-217f-466d-a0ec-90b2bd248665 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating instance_info_cache with network_info: [{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-60e5771a-8e19-483d-bc64-15eca1d39a09 req-2e1b9b9f-217f-466d-a0ec-90b2bd248665 service nova] Releasing lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqHPfSUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:13 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:13 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:13 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f10b5c8-1b93-45af-9e36-79d10d21c9b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:51:13 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5957015b-c9ce-4542-901a-d957e55b6f31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00] added
Nov 14 17:51:13 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a054750-afaf-4fb1-8e47-80012b7c5bbb]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2d4782-8897-46fa-9ea1-45642871481b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqHPfSUO {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqHPfSUO" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b0ae0a-f58f-4ea7-b613-96d5b89a7b73]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqHPfSUO'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0656be-1c82-4721-b3b5-bd6edc94fa81]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d146c8a-c861-4cbc-97d4-ededf3266bd0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[70869458-b566-40fd-bf2a-3147795e1436]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00, portal: 172.16.0.220,3260]
Nov 14 17:51:13 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00, portal: 172.16.0.220,3260] successful.
Nov 14 17:51:13 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.042s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e85d88-2a6e-432c-b8e0-57695fba8a1f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.105s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4934d9-0926-4993-b289-6c244292cbc5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 (non-flash)
Nov 14 17:51:13 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.462s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9cbbec-2597-4a3c-b84f-de2834fd3211]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqHPfSUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-c663571c-1b29-466e-ac2e-1230a1da7b2c req-cd2f378e-f8df-4aac-94a9-63ba5ae0bcee service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Received event network-vif-plugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c663571c-1b29-466e-ac2e-1230a1da7b2c req-cd2f378e-f8df-4aac-94a9-63ba5ae0bcee service nova] Acquiring lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c663571c-1b29-466e-ac2e-1230a1da7b2c req-cd2f378e-f8df-4aac-94a9-63ba5ae0bcee service nova] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c663571c-1b29-466e-ac2e-1230a1da7b2c req-cd2f378e-f8df-4aac-94a9-63ba5ae0bcee service nova] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-c663571c-1b29-466e-ac2e-1230a1da7b2c req-cd2f378e-f8df-4aac-94a9-63ba5ae0bcee service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] No waiting events found dispatching network-vif-plugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:51:13 user nova-compute[76161]: WARNING nova.compute.manager [req-c663571c-1b29-466e-ac2e-1230a1da7b2c req-cd2f378e-f8df-4aac-94a9-63ba5ae0bcee service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Received unexpected event network-vif-plugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a for instance with vm_state building and task_state spawning.
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:51:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Instance spawned successfully.
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:51:13 user nova-compute[76161]: INFO nova.compute.manager [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 14 17:51:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:14 user nova-compute[76161]: INFO nova.compute.manager [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Took 7.21 seconds to build instance.
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eb6b5890-2bf8-45c0-9f1c-9d29a6a034d5 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.409s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.528s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] <== connect_volume: return (1530ms) {'type': 'block', 'scsi_wwn': '23731663132313333', 'path': '/dev/sdi'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731663132313333', 'path': '/dev/sdi'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG nova.objects.instance [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lazy-loading 'flavor' on Instance uuid f8c62b07-2d5b-4619-98ec-b77eb524829a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:51:14 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:51:14 user nova-compute[76161]:   <source dev="/dev/sdi"/>
Nov 14 17:51:14 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:51:14 user nova-compute[76161]:   <serial>8a235387-b484-402a-9696-91c7aa3e8a00</serial>
Nov 14 17:51:14 user nova-compute[76161]: </disk>
Nov 14 17:51:14 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:51:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] No VIF found with MAC fa:16:3e:df:b5:49, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3c2288d2-635f-4763-8a00-cb4c353d002d tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.862s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-8d08decd-f4a8-4c2d-a14d-5b93f76cfd2c req-e69776e1-a7b1-4ce0-939a-21a0aeb96ba1 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received event network-changed-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-8d08decd-f4a8-4c2d-a14d-5b93f76cfd2c req-e69776e1-a7b1-4ce0-939a-21a0aeb96ba1 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Refreshing instance network info cache due to event network-changed-f8e82122-b7bf-4a06-b5cc-084e959e2e11. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8d08decd-f4a8-4c2d-a14d-5b93f76cfd2c req-e69776e1-a7b1-4ce0-939a-21a0aeb96ba1 service nova] Acquiring lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8d08decd-f4a8-4c2d-a14d-5b93f76cfd2c req-e69776e1-a7b1-4ce0-939a-21a0aeb96ba1 service nova] Acquired lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-8d08decd-f4a8-4c2d-a14d-5b93f76cfd2c req-e69776e1-a7b1-4ce0-939a-21a0aeb96ba1 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Refreshing network info cache for port f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-8d08decd-f4a8-4c2d-a14d-5b93f76cfd2c req-e69776e1-a7b1-4ce0-939a-21a0aeb96ba1 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updated VIF entry in instance network info cache for port f8e82122-b7bf-4a06-b5cc-084e959e2e11. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:51:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-8d08decd-f4a8-4c2d-a14d-5b93f76cfd2c req-e69776e1-a7b1-4ce0-939a-21a0aeb96ba1 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updating instance_info_cache with network_info: [{"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8d08decd-f4a8-4c2d-a14d-5b93f76cfd2c req-e69776e1-a7b1-4ce0-939a-21a0aeb96ba1 service nova] Releasing lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:51:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:17 user nova-compute[76161]: INFO nova.compute.manager [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Terminating instance
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.manager [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:51:17 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:51:17 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=6513MB free_disk=25.472179412841797GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance f8c62b07-2d5b-4619-98ec-b77eb524829a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56f47238-81fe-4196-865c-e1ad68cf6fea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 678e458a-aeb6-4f29-b20b-74115179025f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance ef928bc3-c76d-48e2-ae04-8c3c06c42998 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b45e1ad6-d346-442e-a957-9398103b143f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 32fb9960-faa6-443a-88d3-3ee3c68b27fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bc0af785-ac5b-4103-97e2-83285d9154da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 11cabda6-8cc9-481f-b91c-5fd359e98515 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 2ade3f5e-24a0-4989-854a-f4a90e5cf30a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 55765bdd-d12d-4466-af2b-6912e5ae8f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Received event network-vif-unplugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] Acquiring lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] No waiting events found dispatching network-vif-unplugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Received event network-vif-unplugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Received event network-vif-plugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] Acquiring lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] No waiting events found dispatching network-vif-plugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:51:17 user nova-compute[76161]: WARNING nova.compute.manager [req-02069327-a225-4c2c-b925-726c71f7ee95 req-0f2aedc5-657d-4cfc-b81e-987208465d7b service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Received unexpected event network-vif-plugged-1bb2ea53-e638-4012-9fa0-f2ca60290348 for instance with vm_state active and task_state deleting.
Nov 14 17:51:17 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Instance destroyed successfully.
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.objects.instance [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lazy-loading 'resources' on Instance uuid f8c62b07-2d5b-4619-98ec-b77eb524829a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2001480072',display_name='tempest-DeleteServersTestJSON-server-2001480072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2001480072',id=3,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d92618d87174e86a36acfb7d069a698',ramdisk_id='',reservation_id='r-j4v6eqdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-328001957',owner_user_name='tempest-DeleteServersTestJSON-328001957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:49:33Z,user_data=None,user_id='0f5c7bf573614b7dbed7484623bbdddf',uuid=f8c62b07-2d5b-4619-98ec-b77eb524829a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "address": "fa:16:3e:df:b5:49", "network": {"id": "61d20bac-ea5b-4701-87b6-2a93034b65df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1734807919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d92618d87174e86a36acfb7d069a698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb2ea53-e6", "ovs_interfaceid": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Converting VIF {"id": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "address": "fa:16:3e:df:b5:49", "network": {"id": "61d20bac-ea5b-4701-87b6-2a93034b65df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1734807919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d92618d87174e86a36acfb7d069a698", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb2ea53-e6", "ovs_interfaceid": "1bb2ea53-e638-4012-9fa0-f2ca60290348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:b5:49,bridge_name='br-int',has_traffic_filtering=True,id=1bb2ea53-e638-4012-9fa0-f2ca60290348,network=Network(61d20bac-ea5b-4701-87b6-2a93034b65df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb2ea53-e6') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_vif [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:b5:49,bridge_name='br-int',has_traffic_filtering=True,id=1bb2ea53-e638-4012-9fa0-f2ca60290348,network=Network(61d20bac-ea5b-4701-87b6-2a93034b65df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb2ea53-e6') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bb2ea53-e6, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3a7a70d-2182-4fad-8b32-53793e457adc) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:51:17 user nova-compute[76161]: INFO os_vif [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:b5:49,bridge_name='br-int',has_traffic_filtering=True,id=1bb2ea53-e638-4012-9fa0-f2ca60290348,network=Network(61d20bac-ea5b-4701-87b6-2a93034b65df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb2ea53-e6')
Nov 14 17:51:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqHPfSUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:17 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b379d01-3c9a-4356-a4e2-ce93cdb68a06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:51:17 user nova-compute[76161]: No targets found.
Nov 14 17:51:17 user nova-compute[76161]: iSNS:
Nov 14 17:51:17 user nova-compute[76161]: No targets found.
Nov 14 17:51:17 user nova-compute[76161]: STATIC:
Nov 14 17:51:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc
Nov 14 17:51:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:51:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:51:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00
Nov 14 17:51:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f
Nov 14 17:51:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b
Nov 14 17:51:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108
Nov 14 17:51:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed
Nov 14 17:51:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:17 user nova-compute[76161]: FIRMWARE:
Nov 14 17:51:17 user nova-compute[76161]: No targets found.
Nov 14 17:51:17 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:51:17 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:51:17 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae581950-6624-4f6a-b6db-fc649f009f5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91c517d-c362-4ac5-9f52-b6c3def2acc8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 (non-flash)
Nov 14 17:51:17 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:17 user nova-compute[76161]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 (non-flash)
Nov 14 17:51:17 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f07836d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00'): ({'sdi'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Removing single pathed devices sdi {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d864c58b-cd80-4ee4-b8d6-4ceaaf4e55b2]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06bcf16-4e6b-449c-9ce3-a8ad55a67ab6]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Flushing IO for device /dev/sdi {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a601db84-77e9-4907-a4c3-91c17cbb3d5e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[22895807-e2fa-4960-bfc1-6fddaecd124e]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] SCSI volumes sdi have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb7e9fc-f5da-434b-bb81-7737e9b74557]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a90f8d-c8d6-4be8-a17f-adfd1be8ab6d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00, portal: 172.16.0.220,3260]
Nov 14 17:51:18 user nova-compute[76161]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00, portal: 172.16.0.220,3260] successful.
Nov 14 17:51:18 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a235387-b484-402a-9696-91c7aa3e8a00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e76da4-8dc1-4703-aaba-18967fbc602b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] <== disconnect_volume: return (320ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:51:18 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Deleting instance files /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a_del
Nov 14 17:51:18 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Deletion of /opt/stack/data/nova/instances/f8c62b07-2d5b-4619-98ec-b77eb524829a_del complete
Nov 14 17:51:18 user nova-compute[76161]: INFO nova.compute.manager [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 17:51:18 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:51:18 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:18 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Took 0.59 seconds to deallocate network for instance.
Nov 14 17:51:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:19 user nova-compute[76161]: INFO nova.compute.manager [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Took 0.79 seconds to detach 1 volumes for instance.
Nov 14 17:51:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-9ccb652f-2160-4915-8d84-4e2e181c5ff3 req-b3febe89-a8be-47a7-b333-d7a5e6259405 service nova] [instance: f8c62b07-2d5b-4619-98ec-b77eb524829a] Received event network-vif-deleted-1bb2ea53-e638-4012-9fa0-f2ca60290348 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:20 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:51:20 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:51:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:20 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Deleted allocations for instance f8c62b07-2d5b-4619-98ec-b77eb524829a
Nov 14 17:51:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-999481c6-c09a-4e0a-81a1-54e44fafa92b tempest-DeleteServersTestJSON-328001957 tempest-DeleteServersTestJSON-328001957-project-member] Lock "f8c62b07-2d5b-4619-98ec-b77eb524829a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.199s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-6e136188-a6ef-42c4-addb-f336cb0f66f3 req-83257177-fa3c-40a1-b531-5f1e76ae0532 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received event network-changed-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-6e136188-a6ef-42c4-addb-f336cb0f66f3 req-83257177-fa3c-40a1-b531-5f1e76ae0532 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Refreshing instance network info cache due to event network-changed-1441c480-e1b4-4233-a76c-d8de659dc72e. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:51:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6e136188-a6ef-42c4-addb-f336cb0f66f3 req-83257177-fa3c-40a1-b531-5f1e76ae0532 service nova] Acquiring lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6e136188-a6ef-42c4-addb-f336cb0f66f3 req-83257177-fa3c-40a1-b531-5f1e76ae0532 service nova] Acquired lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:21 user nova-compute[76161]: DEBUG nova.network.neutron [req-6e136188-a6ef-42c4-addb-f336cb0f66f3 req-83257177-fa3c-40a1-b531-5f1e76ae0532 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Refreshing network info cache for port 1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:51:22 user nova-compute[76161]: DEBUG nova.network.neutron [req-6e136188-a6ef-42c4-addb-f336cb0f66f3 req-83257177-fa3c-40a1-b531-5f1e76ae0532 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Updated VIF entry in instance network info cache for port 1441c480-e1b4-4233-a76c-d8de659dc72e. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:51:22 user nova-compute[76161]: DEBUG nova.network.neutron [req-6e136188-a6ef-42c4-addb-f336cb0f66f3 req-83257177-fa3c-40a1-b531-5f1e76ae0532 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Updating instance_info_cache with network_info: [{"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6e136188-a6ef-42c4-addb-f336cb0f66f3 req-83257177-fa3c-40a1-b531-5f1e76ae0532 service nova] Releasing lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "678e458a-aeb6-4f29-b20b-74115179025f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG nova.objects.instance [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lazy-loading 'flavor' on Instance uuid 678e458a-aeb6-4f29-b20b-74115179025f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "678e458a-aeb6-4f29-b20b-74115179025f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:23 user nova-compute[76161]: INFO nova.compute.manager [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Attaching volume 0ddf5199-9b1b-4706-b87a-9a571929de07 to /dev/vdb
Nov 14 17:51:23 user nova-compute[76161]: DEBUG os_brick.utils [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7079e34f-3a94-40a1-b0af-e94cc944d0cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de9ec77-2b03-4f84-8058-2e360f35a606]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c5ae2f-2eb9-4c11-b027-027bc44a7925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d97b9e-7ecb-44fe-814e-dca1edb4bb5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:51:23 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:51:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d82bee1-abce-48b6-832e-d6309bbec2dd]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG os_brick.utils [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:23 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Updating existing volume attachment record: 113d6713-d9d5-465e-a407-ff61e1a30af7 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:51:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-4858e702-78ff-4400-9a33-ab6174578d35 req-1d87a0ac-42d4-4663-a3b9-04a82b0fbcec service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received event network-changed-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-4858e702-78ff-4400-9a33-ab6174578d35 req-1d87a0ac-42d4-4663-a3b9-04a82b0fbcec service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Refreshing instance network info cache due to event network-changed-7d1fbf12-dfd7-4d29-9975-6e9235084613. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:51:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4858e702-78ff-4400-9a33-ab6174578d35 req-1d87a0ac-42d4-4663-a3b9-04a82b0fbcec service nova] Acquiring lock "refresh_cache-ef928bc3-c76d-48e2-ae04-8c3c06c42998" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4858e702-78ff-4400-9a33-ab6174578d35 req-1d87a0ac-42d4-4663-a3b9-04a82b0fbcec service nova] Acquired lock "refresh_cache-ef928bc3-c76d-48e2-ae04-8c3c06c42998" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-4858e702-78ff-4400-9a33-ab6174578d35 req-1d87a0ac-42d4-4663-a3b9-04a82b0fbcec service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Refreshing network info cache for port 7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:51:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-4858e702-78ff-4400-9a33-ab6174578d35 req-1d87a0ac-42d4-4663-a3b9-04a82b0fbcec service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Updated VIF entry in instance network info cache for port 7d1fbf12-dfd7-4d29-9975-6e9235084613. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:51:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-4858e702-78ff-4400-9a33-ab6174578d35 req-1d87a0ac-42d4-4663-a3b9-04a82b0fbcec service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Updating instance_info_cache with network_info: [{"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4858e702-78ff-4400-9a33-ab6174578d35 req-1d87a0ac-42d4-4663-a3b9-04a82b0fbcec service nova] Releasing lock "refresh_cache-ef928bc3-c76d-48e2-ae04-8c3c06c42998" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG nova.objects.instance [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lazy-loading 'flavor' on Instance uuid ef928bc3-c76d-48e2-ae04-8c3c06c42998 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZwJSfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:29 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:29 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:29 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[576985e6-22e2-4f30-aafd-1e63c85e9efb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:51:29 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6570ce3-3770-4a7a-b8f9-9253e42acb2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07] added
Nov 14 17:51:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a4441-9b58-4dd8-a016-4fc572c14208]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9334b2e2-c86f-4e27-96d1-0b098bf23e22]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nZwJSfvQ {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nZwJSfvQ" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e45c621-e072-4555-942b-5f80586addcd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nZwJSfvQ'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:29 user nova-compute[76161]: INFO nova.compute.manager [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Attaching volume 47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 to /dev/sdc
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[660960ac-4678-4af6-874a-758acf55a661]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0526df-f84b-459f-8324-8a59650209f8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.utils [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c53f90-8ba1-4d67-b7cc-ccfa710b4b71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4987bd-f8bd-446b-84c4-0ab3cc21ccea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ab887b-db35-47fd-9c98-f1d8d2148861]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6091a9c6-f27a-4674-ac7a-64685a736bbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76f5659-c713-4d74-b4ca-9fcd6439b4b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07, portal: 172.16.0.220,3260]
Nov 14 17:51:29 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07, portal: 172.16.0.220,3260] successful.
Nov 14 17:51:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:51:29 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[657c48ed-3571-4d16-a6ad-df37ff8063bd]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[890450b1-978a-49a7-8ba6-27579c2af47c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.utils [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Updating existing volume attachment record: 976d31f6-5a53-4ab7-bf0d-ada840c85449 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6d479-97e6-4edc-b38c-660cf5cd974b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0aeab8-2439-453b-9e06-3563ce2024a9]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:51:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZwJSfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:51:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23333613731356435', 'path': '/dev/sdi'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333613731356435', 'path': '/dev/sdi'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:51:30 user nova-compute[76161]: DEBUG nova.objects.instance [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lazy-loading 'flavor' on Instance uuid 678e458a-aeb6-4f29-b20b-74115179025f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:51:30 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:51:30 user nova-compute[76161]:   <source dev="/dev/sdi"/>
Nov 14 17:51:30 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:51:30 user nova-compute[76161]:   <serial>0ddf5199-9b1b-4706-b87a-9a571929de07</serial>
Nov 14 17:51:30 user nova-compute[76161]: </disk>
Nov 14 17:51:30 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:51:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:51:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:51:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] No VIF found with MAC fa:16:3e:dc:63:3e, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:51:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1f354138-510f-46ff-bbb9-58e085b0a73e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.680s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "678e458a-aeb6-4f29-b20b-74115179025f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:32 user nova-compute[76161]: INFO nova.compute.manager [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Detaching volume 0ddf5199-9b1b-4706-b87a-9a571929de07
Nov 14 17:51:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:32 user nova-compute[76161]: INFO nova.virt.block_device [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Attempting to driver detach volume 0ddf5199-9b1b-4706-b87a-9a571929de07 from mountpoint /dev/vdb
Nov 14 17:51:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Attempting to detach device vdb from instance 678e458a-aeb6-4f29-b20b-74115179025f from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:51:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:51:32 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:51:32 user nova-compute[76161]:   <source dev="/dev/sdi"/>
Nov 14 17:51:32 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:51:32 user nova-compute[76161]:   <serial>0ddf5199-9b1b-4706-b87a-9a571929de07</serial>
Nov 14 17:51:32 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:51:32 user nova-compute[76161]: </disk>
Nov 14 17:51:32 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:51:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Successfully detached device vdb from instance 678e458a-aeb6-4f29-b20b-74115179025f from the persistent domain config.
Nov 14 17:51:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 678e458a-aeb6-4f29-b20b-74115179025f from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:51:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:51:32 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:51:32 user nova-compute[76161]:   <source dev="/dev/sdi"/>
Nov 14 17:51:32 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:51:32 user nova-compute[76161]:   <serial>0ddf5199-9b1b-4706-b87a-9a571929de07</serial>
Nov 14 17:51:32 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:51:32 user nova-compute[76161]: </disk>
Nov 14 17:51:32 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:51:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 678e458a-aeb6-4f29-b20b-74115179025f {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuTzKpAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:34 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:34 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:34 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82641d4-06a2-43ac-a23a-fdf026b0a19c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:51:34 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bf083e-75fe-410e-b18b-4827e6aaa4bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58] added
Nov 14 17:51:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6f76fe-86af-4372-9983-cc144f595787]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db78be1-1642-4378-aa63-e0e0cb06a78a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuTzKpAY {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuTzKpAY" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b60ec59-ad70-42fe-a42c-1c934cda7e33]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VuTzKpAY'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2874d71d-f98e-45a6-90c6-733bca6e1a8a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de6ee2f-3ee0-456a-b6d0-69bfae269246]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5cde08-0374-4d05-bb43-ca952c495599]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58, portal: 172.16.0.220,3260]
Nov 14 17:51:34 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58, portal: 172.16.0.220,3260] successful.
Nov 14 17:51:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c5ce6b-d6ee-431f-8b5a-da1436585d5a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed50a677-5b58-4444-8832-acb878f8072c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a56b30-9378-42c3-9a9e-006f4b5eafb0]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuTzKpAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-922499c0-3824-4b37-9bba-b98e17cfadf3 req-df48b370-b052-4847-b563-b387ccc3c6df service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-changed-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-922499c0-3824-4b37-9bba-b98e17cfadf3 req-df48b370-b052-4847-b563-b387ccc3c6df service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Refreshing instance network info cache due to event network-changed-560312f9-47a0-4257-a55a-e06dfcc78799. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-922499c0-3824-4b37-9bba-b98e17cfadf3 req-df48b370-b052-4847-b563-b387ccc3c6df service nova] Acquiring lock "refresh_cache-b45e1ad6-d346-442e-a957-9398103b143f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-922499c0-3824-4b37-9bba-b98e17cfadf3 req-df48b370-b052-4847-b563-b387ccc3c6df service nova] Acquired lock "refresh_cache-b45e1ad6-d346-442e-a957-9398103b143f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG nova.network.neutron [req-922499c0-3824-4b37-9bba-b98e17cfadf3 req-df48b370-b052-4847-b563-b387ccc3c6df service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Refreshing network info cache for port 560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "b45e1ad6-d346-442e-a957-9398103b143f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lazy-loading 'flavor' on Instance uuid b45e1ad6-d346-442e-a957-9398103b143f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "b45e1ad6-d346-442e-a957-9398103b143f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG nova.network.neutron [req-922499c0-3824-4b37-9bba-b98e17cfadf3 req-df48b370-b052-4847-b563-b387ccc3c6df service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Updated VIF entry in instance network info cache for port 560312f9-47a0-4257-a55a-e06dfcc78799. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG nova.network.neutron [req-922499c0-3824-4b37-9bba-b98e17cfadf3 req-df48b370-b052-4847-b563-b387ccc3c6df service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Updating instance_info_cache with network_info: [{"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "b45e1ad6-d346-442e-a957-9398103b143f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:35 user nova-compute[76161]: INFO nova.compute.manager [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Attaching volume ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c to /dev/vdb
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-922499c0-3824-4b37-9bba-b98e17cfadf3 req-df48b370-b052-4847-b563-b387ccc3c6df service nova] Releasing lock "refresh_cache-b45e1ad6-d346-442e-a957-9398103b143f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG os_brick.utils [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52ab665-3579-4934-8c08-ae627830babf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5630169a-40cf-4afd-b9e2-4bde73bda2f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[96729afb-5bd1-47d2-83a9-5bfbb428d8f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c283a8-d958-4b85-b8f6-aa1d078a572b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:51:35 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:51:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afeeece-e7ba-4425-930c-8c3f6f70be2d]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG os_brick.utils [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Updating existing volume attachment record: 404d9096-26db-45f2-97a6-4f33808fc66a {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23037393066333635', 'path': '/dev/sdj'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037393066333635', 'path': '/dev/sdj'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG nova.objects.instance [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lazy-loading 'flavor' on Instance uuid ef928bc3-c76d-48e2-ae04-8c3c06c42998 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:51:35 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:51:35 user nova-compute[76161]:   <source dev="/dev/sdj"/>
Nov 14 17:51:35 user nova-compute[76161]:   <target dev="sdc" bus="scsi"/>
Nov 14 17:51:35 user nova-compute[76161]:   <serial>47d2c3f9-7507-4d8b-8d5a-12eac6c46e58</serial>
Nov 14 17:51:35 user nova-compute[76161]:   <address type="drive" controller="0" unit="2"/>
Nov 14 17:51:35 user nova-compute[76161]: </disk>
Nov 14 17:51:35 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:51:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] No BDM found with device name sda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:51:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:51:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] No BDM found with device name sdc, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:51:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] No VIF found with MAC fa:16:3e:80:74:d5, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:51:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa89afec-b3d4-4dc3-b688-72c361bc506d tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.853s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:37 user nova-compute[76161]: INFO nova.compute.manager [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Detaching volume 47d2c3f9-7507-4d8b-8d5a-12eac6c46e58
Nov 14 17:51:37 user nova-compute[76161]: INFO nova.virt.block_device [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Attempting to driver detach volume 47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 from mountpoint /dev/sdc
Nov 14 17:51:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Attempting to detach device sdc from instance ef928bc3-c76d-48e2-ae04-8c3c06c42998 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:51:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:51:37 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:51:37 user nova-compute[76161]:   <source dev="/dev/sdj"/>
Nov 14 17:51:37 user nova-compute[76161]:   <target dev="sdc" bus="scsi"/>
Nov 14 17:51:37 user nova-compute[76161]:   <serial>47d2c3f9-7507-4d8b-8d5a-12eac6c46e58</serial>
Nov 14 17:51:37 user nova-compute[76161]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 17:51:37 user nova-compute[76161]: </disk>
Nov 14 17:51:37 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:51:37 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Successfully detached device sdc from instance ef928bc3-c76d-48e2-ae04-8c3c06c42998 from the persistent domain config.
Nov 14 17:51:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ef928bc3-c76d-48e2-ae04-8c3c06c42998 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:51:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:51:37 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:51:37 user nova-compute[76161]:   <source dev="/dev/sdj"/>
Nov 14 17:51:37 user nova-compute[76161]:   <target dev="sdc" bus="scsi"/>
Nov 14 17:51:37 user nova-compute[76161]:   <serial>47d2c3f9-7507-4d8b-8d5a-12eac6c46e58</serial>
Nov 14 17:51:37 user nova-compute[76161]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 17:51:37 user nova-compute[76161]: </disk>
Nov 14 17:51:37 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:51:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ef928bc3-c76d-48e2-ae04-8c3c06c42998 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:51:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-71322e31-94e6-4110-bb66-9cf901af48d3 req-a207ada1-4c13-4eee-8423-6b903031f0d5 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-changed-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-71322e31-94e6-4110-bb66-9cf901af48d3 req-a207ada1-4c13-4eee-8423-6b903031f0d5 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Refreshing instance network info cache due to event network-changed-8180a18a-275a-422b-bc71-e1846af90d29. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:51:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-71322e31-94e6-4110-bb66-9cf901af48d3 req-a207ada1-4c13-4eee-8423-6b903031f0d5 service nova] Acquiring lock "refresh_cache-32fb9960-faa6-443a-88d3-3ee3c68b27fe" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-71322e31-94e6-4110-bb66-9cf901af48d3 req-a207ada1-4c13-4eee-8423-6b903031f0d5 service nova] Acquired lock "refresh_cache-32fb9960-faa6-443a-88d3-3ee3c68b27fe" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:38 user nova-compute[76161]: DEBUG nova.network.neutron [req-71322e31-94e6-4110-bb66-9cf901af48d3 req-a207ada1-4c13-4eee-8423-6b903031f0d5 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Refreshing network info cache for port 8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:51:39 user nova-compute[76161]: DEBUG nova.network.neutron [req-71322e31-94e6-4110-bb66-9cf901af48d3 req-a207ada1-4c13-4eee-8423-6b903031f0d5 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Updated VIF entry in instance network info cache for port 8180a18a-275a-422b-bc71-e1846af90d29. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:51:39 user nova-compute[76161]: DEBUG nova.network.neutron [req-71322e31-94e6-4110-bb66-9cf901af48d3 req-a207ada1-4c13-4eee-8423-6b903031f0d5 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Updating instance_info_cache with network_info: [{"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-71322e31-94e6-4110-bb66-9cf901af48d3 req-a207ada1-4c13-4eee-8423-6b903031f0d5 service nova] Releasing lock "refresh_cache-32fb9960-faa6-443a-88d3-3ee3c68b27fe" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:39 user nova-compute[76161]: INFO nova.compute.manager [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Rebuilding instance
Nov 14 17:51:39 user nova-compute[76161]: DEBUG nova.compute.manager [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVJoLyHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:40 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:40 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:40 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c77319-b5df-4f9c-a41a-96affc2868ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:51:40 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab9487-1251-4274-bec7-c4544585398c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c] added
Nov 14 17:51:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2e4638-5b26-46eb-852b-8f2a9b441c9f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2506418a-721b-41d2-a942-96b60214f3b8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVJoLyHA {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVJoLyHA" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b74c544-6116-41ce-aa0e-e191bf919792]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVJoLyHA'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0444bbe-9b0c-4966-86ae-c7338b1d1c2b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8427d9f0-a35a-4424-aada-1871406ece80]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-41a47662-cf04-45aa-ac88-780d9d6b39fc req-b83671e1-9c20-4a3e-83a0-77b1992460f4 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-vif-unplugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-41a47662-cf04-45aa-ac88-780d9d6b39fc req-b83671e1-9c20-4a3e-83a0-77b1992460f4 service nova] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-41a47662-cf04-45aa-ac88-780d9d6b39fc req-b83671e1-9c20-4a3e-83a0-77b1992460f4 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-41a47662-cf04-45aa-ac88-780d9d6b39fc req-b83671e1-9c20-4a3e-83a0-77b1992460f4 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-41a47662-cf04-45aa-ac88-780d9d6b39fc req-b83671e1-9c20-4a3e-83a0-77b1992460f4 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] No waiting events found dispatching network-vif-unplugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:51:40 user nova-compute[76161]: WARNING nova.compute.manager [req-41a47662-cf04-45aa-ac88-780d9d6b39fc req-b83671e1-9c20-4a3e-83a0-77b1992460f4 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received unexpected event network-vif-unplugged-8180a18a-275a-422b-bc71-e1846af90d29 for instance with vm_state active and task_state rebuilding.
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ba92f4-fb94-4e56-b938-8a28b439ef53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c, portal: 172.16.0.220,3260]
Nov 14 17:51:40 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c, portal: 172.16.0.220,3260] successful.
Nov 14 17:51:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdbd5ea-20ff-4a68-a951-ce72fbf09f7f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[688f1047-3425-4045-a7ed-8f203fca2254]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef026a9-1f18-4f86-84fb-b56742af2115]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVJoLyHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:51:40 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Instance destroyed successfully.
Nov 14 17:51:40 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Instance destroyed successfully.
Nov 14 17:51:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-655941733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-666366678',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0qfeGCNZ8gGzIgerfVDfT/REFNEKBmHXss/bGsLZbbzc6KURhywrEepQWnmaphwMEjeaXsblW4CfozsJdXaIg0LiAQIBG9pM3LmTWPAIyPcUriJ85J0I8eim3SdheLFg==',key_name='tempest-keypair-279762098',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1801c743af0c4de098b6f24fd98c3d89',ramdisk_id='',reservation_id='r-pg3zw022',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1345728502',owner_user_name='tempest-ServerActionsV293TestJSON-1345728502-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e682032e8b74286b9cc47624f3f4ae0',uuid=32fb9960-faa6-443a-88d3-3ee3c68b27fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converting VIF {"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_vif [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8180a18a-27, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dec9d9b3-46b8-4b5b-9139-8a33fa497a1c) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:40 user nova-compute[76161]: INFO os_vif [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27')
Nov 14 17:51:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqZhQwgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:40 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 17:51:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26362313865353030', 'path': '/dev/sdk'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362313865353030', 'path': '/dev/sdk'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.631s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG nova.objects.instance [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lazy-loading 'flavor' on Instance uuid b45e1ad6-d346-442e-a957-9398103b143f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b6d798-d5ca-4847-a175-1ba3c190a14a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:51:41 user nova-compute[76161]: No targets found.
Nov 14 17:51:41 user nova-compute[76161]: iSNS:
Nov 14 17:51:41 user nova-compute[76161]: No targets found.
Nov 14 17:51:41 user nova-compute[76161]: STATIC:
Nov 14 17:51:41 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc
Nov 14 17:51:41 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:41 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:41 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:51:41 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:41 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:41 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:51:41 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:41 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:41 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58
Nov 14 17:51:41 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:41 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:41 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f
Nov 14 17:51:41 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:41 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:41 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b
Nov 14 17:51:41 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:41 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:41 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07
Nov 14 17:51:41 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:41 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:41 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c
Nov 14 17:51:41 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:41 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:41 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108
Nov 14 17:51:41 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:41 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:41 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed
Nov 14 17:51:41 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:41 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:41 user nova-compute[76161]: FIRMWARE:
Nov 14 17:51:41 user nova-compute[76161]: No targets found.
Nov 14 17:51:41 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:51:41 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:51:41 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[65faa95f-6aa2-4d80-a5a5-1a83fd7bd073]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 17:51:41 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:51:41 user nova-compute[76161]:   <source dev="/dev/sdk"/>
Nov 14 17:51:41 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:51:41 user nova-compute[76161]:   <serial>ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c</serial>
Nov 14 17:51:41 user nova-compute[76161]: </disk>
Nov 14 17:51:41 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e381b-6674-45aa-98b4-b7518d1a93f8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:41 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:41 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:41 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f8191cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab5f625-16ba-4699-83ad-ccc291933561]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7003c7-5130-4fa7-bb2d-89960aca96a6]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88dc679-9c80-4959-b06e-22be500eefbd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[55167642-faf7-48d5-bb51-b6a97262c734]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ab9e32-5941-4652-95e5-b66cb42bc780]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8897e40-31ab-40d2-b2dc-876178a25463]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260]
Nov 14 17:51:41 user nova-compute[76161]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260] successful.
Nov 14 17:51:41 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb44632-e7b4-4d10-b3b7-3f01e6e8cd40]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] <== disconnect_volume: return (979ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:51:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Deleting instance files /opt/stack/data/nova/instances/32fb9960-faa6-443a-88d3-3ee3c68b27fe_del
Nov 14 17:51:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Deletion of /opt/stack/data/nova/instances/32fb9960-faa6-443a-88d3-3ee3c68b27fe_del complete
Nov 14 17:51:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:51:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] No VIF found with MAC fa:16:3e:5c:15:f4, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:51:42 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 32fb9960-faa6-443a-88d3-3ee3c68b27fe could not be found.
Nov 14 17:51:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqZhQwgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:42 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[264e121e-b4dc-47f3-91f0-e06788d7cb0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:51:42 user nova-compute[76161]: No targets found.
Nov 14 17:51:42 user nova-compute[76161]: iSNS:
Nov 14 17:51:42 user nova-compute[76161]: No targets found.
Nov 14 17:51:42 user nova-compute[76161]: STATIC:
Nov 14 17:51:42 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:51:42 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:42 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:42 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:51:42 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:42 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:42 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58
Nov 14 17:51:42 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:42 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:42 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f
Nov 14 17:51:42 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:42 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:42 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b
Nov 14 17:51:42 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:42 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:42 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07
Nov 14 17:51:42 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:42 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:42 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c
Nov 14 17:51:42 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:42 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:42 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108
Nov 14 17:51:42 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:42 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:42 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed
Nov 14 17:51:42 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:42 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:42 user nova-compute[76161]: FIRMWARE:
Nov 14 17:51:42 user nova-compute[76161]: No targets found.
Nov 14 17:51:42 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:51:42 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:51:42 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc03d70c-861a-4c13-bfbf-bf3fa0e18a49 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "b45e1ad6-d346-442e-a957-9398103b143f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.871s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb78326-61a6-45e6-adf0-ba7cd079be59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecd42f4-6303-4697-a4ee-b83dfc4352b0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:42 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:42 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:42 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f803eb00>, {}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Disconnecting from: [] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] <== disconnect_volume: return (89ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-163a9637-269c-4d83-9b5d-d4e104438b24 req-f536afc6-d3c3-4334-b516-234b4949d22a service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-163a9637-269c-4d83-9b5d-d4e104438b24 req-f536afc6-d3c3-4334-b516-234b4949d22a service nova] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-163a9637-269c-4d83-9b5d-d4e104438b24 req-f536afc6-d3c3-4334-b516-234b4949d22a service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-163a9637-269c-4d83-9b5d-d4e104438b24 req-f536afc6-d3c3-4334-b516-234b4949d22a service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-163a9637-269c-4d83-9b5d-d4e104438b24 req-f536afc6-d3c3-4334-b516-234b4949d22a service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] No waiting events found dispatching network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:51:42 user nova-compute[76161]: WARNING nova.compute.manager [req-163a9637-269c-4d83-9b5d-d4e104438b24 req-f536afc6-d3c3-4334-b516-234b4949d22a service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received unexpected event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 for instance with vm_state active and task_state rebuilding.
Nov 14 17:51:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Preparing to wait for external event volume-reimaged-c755112f-0941-40de-a17b-9d0c182004dc {{(pid=76161) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b07ad1ed-0fd7-424b-85e8-1c58fc0b8ea9 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] [instance: b45e1ad6-d346-442e-a957-9398103b143f] volume_snapshot_create: create_info: {'snapshot_id': '86b4e731-cb64-4420-85cd-0a05db825bc7', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=76161) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b07ad1ed-0fd7-424b-85e8-1c58fc0b8ea9 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] [instance: b45e1ad6-d346-442e-a957-9398103b143f] snap xml: <domainsnapshot>
Nov 14 17:51:42 user nova-compute[76161]:   <disks>
Nov 14 17:51:42 user nova-compute[76161]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 14 17:51:42 user nova-compute[76161]:       <source file="/dev/new_file"/>
Nov 14 17:51:42 user nova-compute[76161]:     </disk>
Nov 14 17:51:42 user nova-compute[76161]:     <disk name="vda" snapshot="no"/>
Nov 14 17:51:42 user nova-compute[76161]:   </disks>
Nov 14 17:51:42 user nova-compute[76161]: </domainsnapshot>
Nov 14 17:51:42 user nova-compute[76161]:  {{(pid=76161) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 17:51:42 user nova-compute[76161]: DEBUG nova.objects.instance [None req-b07ad1ed-0fd7-424b-85e8-1c58fc0b8ea9 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] Lazy-loading 'system_metadata' on Instance uuid b45e1ad6-d346-442e-a957-9398103b143f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:43 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b07ad1ed-0fd7-424b-85e8-1c58fc0b8ea9 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [None req-b07ad1ed-0fd7-424b-85e8-1c58fc0b8ea9 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f] Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     rv = execute(f, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     six.reraise(c, e, tb)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     raise value
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     rv = meth(*args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f] 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [None req-b07ad1ed-0fd7-424b-85e8-1c58fc0b8ea9 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f] Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     self._volume_snapshot_create(context, instance, guest,
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     rv = execute(f, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     six.reraise(c, e, tb)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     raise value
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     rv = meth(*args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f] 
Nov 14 17:51:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-50b9114d-63b2-4e5b-aeca-a7f4e4d14897 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] [instance: b45e1ad6-d346-442e-a957-9398103b143f] volume_snapshot_delete: delete_info: {'volume_id': 'ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c'} {{(pid=76161) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [None req-50b9114d-63b2-4e5b-aeca-a7f4e4d14897 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f] Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f]     if delete_info['type'] != 'qcow2':
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f] KeyError: 'type'
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [instance: b45e1ad6-d346-442e-a957-9398103b143f] 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [None req-b07ad1ed-0fd7-424b-85e8-1c58fc0b8ea9 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 86b4e731-cb64-4420-85cd-0a05db825bc7 could not be found.
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 86b4e731-cb64-4420-85cd-0a05db825bc7 could not be found. (HTTP 404) (Request-ID: req-eb18ed92-97d9-4002-bd0f-800010d584d1)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 86b4e731-cb64-4420-85cd-0a05db825bc7 could not be found.
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver [None req-50b9114d-63b2-4e5b-aeca-a7f4e4d14897 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-c4ba3912-7509-42da-9d14-8b7569800185)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver 
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 17:51:43 user nova-compute[76161]: ERROR nova.virt.libvirt.driver 
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server [None req-b07ad1ed-0fd7-424b-85e8-1c58fc0b8ea9 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server 
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server [None req-50b9114d-63b2-4e5b-aeca-a7f4e4d14897 tempest-VolumesAssistedSnapshotsTest-2025674933 tempest-VolumesAssistedSnapshotsTest-2025674933-project] Exception during message handling: KeyError: 'type'
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 17:51:43 user nova-compute[76161]: ERROR oslo_messaging.rpc.server 
Nov 14 17:51:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "b45e1ad6-d346-442e-a957-9398103b143f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:43 user nova-compute[76161]: INFO nova.compute.manager [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Detaching volume ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c
Nov 14 17:51:43 user nova-compute[76161]: INFO nova.virt.block_device [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Attempting to driver detach volume ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c from mountpoint /dev/vdb
Nov 14 17:51:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Attempting to detach device vdb from instance b45e1ad6-d346-442e-a957-9398103b143f from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:51:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 17:51:43 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:51:43 user nova-compute[76161]:   <source dev="/dev/sdk"/>
Nov 14 17:51:43 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:51:43 user nova-compute[76161]:   <serial>ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c</serial>
Nov 14 17:51:43 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:51:43 user nova-compute[76161]: </disk>
Nov 14 17:51:43 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:51:43 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Successfully detached device vdb from instance b45e1ad6-d346-442e-a957-9398103b143f from the persistent domain config.
Nov 14 17:51:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b45e1ad6-d346-442e-a957-9398103b143f from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:51:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 17:51:43 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:51:43 user nova-compute[76161]:   <source dev="/dev/sdk"/>
Nov 14 17:51:43 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:51:43 user nova-compute[76161]:   <serial>ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c</serial>
Nov 14 17:51:43 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:51:43 user nova-compute[76161]: </disk>
Nov 14 17:51:43 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:51:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b45e1ad6-d346-442e-a957-9398103b143f {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:51:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:53 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 678e458a-aeb6-4f29-b20b-74115179025f is timed out.
Nov 14 17:51:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Successfully detached device vdb from instance 678e458a-aeb6-4f29-b20b-74115179025f from the live domain config.
Nov 14 17:51:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZwJSfvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:53 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2509efb-8d87-45d4-b45d-59270edd0789]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:51:53 user nova-compute[76161]: No targets found.
Nov 14 17:51:53 user nova-compute[76161]: iSNS:
Nov 14 17:51:53 user nova-compute[76161]: No targets found.
Nov 14 17:51:53 user nova-compute[76161]: STATIC:
Nov 14 17:51:53 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc
Nov 14 17:51:53 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:53 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:53 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:51:53 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:53 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:53 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:51:53 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:53 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:53 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58
Nov 14 17:51:53 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:53 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:53 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f
Nov 14 17:51:53 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:53 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:53 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b
Nov 14 17:51:53 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:53 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:53 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07
Nov 14 17:51:53 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:53 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:53 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c
Nov 14 17:51:53 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:53 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:53 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108
Nov 14 17:51:53 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:53 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:53 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed
Nov 14 17:51:53 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:53 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:53 user nova-compute[76161]: FIRMWARE:
Nov 14 17:51:53 user nova-compute[76161]: No targets found.
Nov 14 17:51:53 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:51:53 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:51:53 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba1e343-46e1-4190-bdfe-e53aa6d6dd3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b78229-bd50-4d51-ab3c-baaa287ed09c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:53 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:53 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:53 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0283880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07'): ({'sdi'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Removing single pathed devices sdi {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f39062-340a-4e78-be90-ba3d93c3bdd6]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d78a53-dabc-42bf-90f8-4921992c19ad]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Flushing IO for device /dev/sdi {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f331306-f54e-4e79-961d-07ad8a79d46b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.038s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f663c38d-e6e4-4f69-913f-ada557295554]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] SCSI volumes sdi have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e483b75e-8f7c-405a-b2b8-b6d61e36d2a0]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[732af1cf-5230-40c5-89e1-070e1c025625]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07, portal: 172.16.0.220,3260]
Nov 14 17:51:53 user nova-compute[76161]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07, portal: 172.16.0.220,3260] successful.
Nov 14 17:51:53 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddf5199-9b1b-4706-b87a-9a571929de07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5891049a-dc6c-425c-86e0-1630879c91fd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] <== disconnect_volume: return (347ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:51:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:54 user nova-compute[76161]: DEBUG nova.objects.instance [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lazy-loading 'flavor' on Instance uuid 678e458a-aeb6-4f29-b20b-74115179025f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b88b9682-0ff6-4a1f-9392-40500bb970b8 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.087s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-72021e15-a33b-48cf-87b1-957db37eb29a req-c137c3f9-9a77-4759-9c7c-5179fee515ea service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-changed-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-72021e15-a33b-48cf-87b1-957db37eb29a req-c137c3f9-9a77-4759-9c7c-5179fee515ea service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing instance network info cache due to event network-changed-dc4feb84-e8d8-471c-b343-9cc484201a86. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:51:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-72021e15-a33b-48cf-87b1-957db37eb29a req-c137c3f9-9a77-4759-9c7c-5179fee515ea service nova] Acquiring lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-72021e15-a33b-48cf-87b1-957db37eb29a req-c137c3f9-9a77-4759-9c7c-5179fee515ea service nova] Acquired lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:56 user nova-compute[76161]: DEBUG nova.network.neutron [req-72021e15-a33b-48cf-87b1-957db37eb29a req-c137c3f9-9a77-4759-9c7c-5179fee515ea service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Refreshing network info cache for port dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:51:56 user nova-compute[76161]: DEBUG nova.network.neutron [req-72021e15-a33b-48cf-87b1-957db37eb29a req-c137c3f9-9a77-4759-9c7c-5179fee515ea service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updated VIF entry in instance network info cache for port dc4feb84-e8d8-471c-b343-9cc484201a86. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:51:56 user nova-compute[76161]: DEBUG nova.network.neutron [req-72021e15-a33b-48cf-87b1-957db37eb29a req-c137c3f9-9a77-4759-9c7c-5179fee515ea service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [{"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-72021e15-a33b-48cf-87b1-957db37eb29a req-c137c3f9-9a77-4759-9c7c-5179fee515ea service nova] Releasing lock "refresh_cache-bc0af785-ac5b-4103-97e2-83285d9154da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:57 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ef928bc3-c76d-48e2-ae04-8c3c06c42998 is timed out.
Nov 14 17:51:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Successfully detached device sdc from instance ef928bc3-c76d-48e2-ae04-8c3c06c42998 from the live domain config.
Nov 14 17:51:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuTzKpAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:57 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc7fbd4-8213-4d5f-9ea2-7e07526a484a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:51:57 user nova-compute[76161]: No targets found.
Nov 14 17:51:57 user nova-compute[76161]: iSNS:
Nov 14 17:51:57 user nova-compute[76161]: No targets found.
Nov 14 17:51:57 user nova-compute[76161]: STATIC:
Nov 14 17:51:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:51:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:51:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58
Nov 14 17:51:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f
Nov 14 17:51:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b
Nov 14 17:51:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c
Nov 14 17:51:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108
Nov 14 17:51:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed
Nov 14 17:51:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:51:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:51:57 user nova-compute[76161]: FIRMWARE:
Nov 14 17:51:57 user nova-compute[76161]: No targets found.
Nov 14 17:51:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:51:57 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:51:57 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c6e813-5067-4643-9e7e-7c41823556f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[46470a8f-dcc4-459c-80bb-0e0cf794d40e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:51:57 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:51:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0128430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58'): ({'sdj'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Removing single pathed devices sdj {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82f3588-cba1-4438-89c7-63e3d94a245d]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e64ffd0-43dd-4c01-9dab-943def389134]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Flushing IO for device /dev/sdj {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e530df46-e803-4e67-a3c5-375d4aa7672c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.047s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b62a6a-2837-4521-bfcc-7175df5a623a]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] SCSI volumes sdj have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b545b380-e381-4c8a-b0a3-1d6a3614e0ac]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3531b37d-9dad-43d4-b3f5-88f8a8e29089]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58, portal: 172.16.0.220,3260]
Nov 14 17:51:58 user nova-compute[76161]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58, portal: 172.16.0.220,3260] successful.
Nov 14 17:51:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d2c3f9-7507-4d8b-8d5a-12eac6c46e58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c8ad04-17a6-4a6b-a8f5-ef8a5e85d4bb]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] <== disconnect_volume: return (343ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-4f3531ef-1ce8-49f4-bcdd-553c36a2acb2 req-1b65f278-44ce-489c-a816-665bc228e331 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-changed-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-4f3531ef-1ce8-49f4-bcdd-553c36a2acb2 req-1b65f278-44ce-489c-a816-665bc228e331 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing instance network info cache due to event network-changed-72a8f902-4304-40a0-ae7f-308ddf7e4956. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4f3531ef-1ce8-49f4-bcdd-553c36a2acb2 req-1b65f278-44ce-489c-a816-665bc228e331 service nova] Acquiring lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4f3531ef-1ce8-49f4-bcdd-553c36a2acb2 req-1b65f278-44ce-489c-a816-665bc228e331 service nova] Acquired lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG nova.network.neutron [req-4f3531ef-1ce8-49f4-bcdd-553c36a2acb2 req-1b65f278-44ce-489c-a816-665bc228e331 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Refreshing network info cache for port 72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-76b8f308-b165-454c-bf99-00a20b7867f2 req-f0982e4c-7e12-4782-b74e-f38f05c59b40 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event volume-reimaged-c755112f-0941-40de-a17b-9d0c182004dc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-76b8f308-b165-454c-bf99-00a20b7867f2 req-f0982e4c-7e12-4782-b74e-f38f05c59b40 service nova] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-76b8f308-b165-454c-bf99-00a20b7867f2 req-f0982e4c-7e12-4782-b74e-f38f05c59b40 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-76b8f308-b165-454c-bf99-00a20b7867f2 req-f0982e4c-7e12-4782-b74e-f38f05c59b40 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-76b8f308-b165-454c-bf99-00a20b7867f2 req-f0982e4c-7e12-4782-b74e-f38f05c59b40 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Processing event volume-reimaged-c755112f-0941-40de-a17b-9d0c182004dc {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:51:58 user nova-compute[76161]: INFO nova.virt.block_device [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Booting with volume c755112f-0941-40de-a17b-9d0c182004dc at /dev/vda
Nov 14 17:51:58 user nova-compute[76161]: DEBUG os_brick.utils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d047879f-bcef-4a08-a5ab-3adc8fdac7f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[53047da1-078c-46e7-bbfa-32739b599a7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2eab20-3e83-4803-a75f-c5bed19b6d90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[04706e34-d4cf-47f8-90e7-ef817bb03b8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:51:58 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be1150f-1cbf-41a4-b2b8-6d328ceefc79]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG os_brick.utils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Updating existing volume attachment record: 447da306-80c6-4123-a0bf-e54b194abefb {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "bc0af785-ac5b-4103-97e2-83285d9154da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:58 user nova-compute[76161]: INFO nova.compute.manager [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Terminating instance
Nov 14 17:51:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lazy-loading 'flavor' on Instance uuid ef928bc3-c76d-48e2-ae04-8c3c06c42998 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e873d429-761d-4fd1-8541-8b31d87fe680 tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.893s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG nova.network.neutron [req-4f3531ef-1ce8-49f4-bcdd-553c36a2acb2 req-1b65f278-44ce-489c-a816-665bc228e331 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updated VIF entry in instance network info cache for port 72a8f902-4304-40a0-ae7f-308ddf7e4956. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG nova.network.neutron [req-4f3531ef-1ce8-49f4-bcdd-553c36a2acb2 req-1b65f278-44ce-489c-a816-665bc228e331 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [{"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4f3531ef-1ce8-49f4-bcdd-553c36a2acb2 req-1b65f278-44ce-489c-a816-665bc228e331 service nova] Releasing lock "refresh_cache-11cabda6-8cc9-481f-b91c-5fd359e98515" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-26379f94-863a-45c9-bfb2-942df015f922 req-a8fa4c31-d542-4d61-96f7-3d18cd9884a7 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-26379f94-863a-45c9-bfb2-942df015f922 req-a8fa4c31-d542-4d61-96f7-3d18cd9884a7 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-26379f94-863a-45c9-bfb2-942df015f922 req-a8fa4c31-d542-4d61-96f7-3d18cd9884a7 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-26379f94-863a-45c9-bfb2-942df015f922 req-a8fa4c31-d542-4d61-96f7-3d18cd9884a7 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-26379f94-863a-45c9-bfb2-942df015f922 req-a8fa4c31-d542-4d61-96f7-3d18cd9884a7 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-unplugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-26379f94-863a-45c9-bfb2-942df015f922 req-a8fa4c31-d542-4d61-96f7-3d18cd9884a7 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:51:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-unplugged-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-dc4feb84-e8d8-471c-b343-9cc484201a86 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:00 user nova-compute[76161]: WARNING nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-dc4feb84-e8d8-471c-b343-9cc484201a86 for instance with vm_state active and task_state deleting.
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-unplugged-497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-497ff416-9e25-4b65-915b-46b01d17e41f for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-497ff416-9e25-4b65-915b-46b01d17e41f {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:00 user nova-compute[76161]: WARNING nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-497ff416-9e25-4b65-915b-46b01d17e41f for instance with vm_state active and task_state deleting.
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-unplugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6c2a793a-41f0-4098-97ef-f0e0c784f3ab req-0cf15c73-1583-456d-8d56-1e67aab68d03 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:00 user nova-compute[76161]: INFO nova.compute.manager [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Terminating instance
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Instance destroyed successfully.
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.objects.instance [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lazy-loading 'resources' on Instance uuid bc0af785-ac5b-4103-97e2-83285d9154da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f5:88,bridge_name='br-int',has_traffic_filtering=True,id=dc4feb84-e8d8-471c-b343-9cc484201a86,network=Network(c533480a-7189-4c46-8ac1-fe59af3ad0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4feb84-e8') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f5:88,bridge_name='br-int',has_traffic_filtering=True,id=dc4feb84-e8d8-471c-b343-9cc484201a86,network=Network(c533480a-7189-4c46-8ac1-fe59af3ad0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4feb84-e8') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc4feb84-e8, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c789f418-c26c-4d4b-a555-0b974c98299f) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-033f3eb1-53f7-48f7-906f-1de4ec16cdfa req-e50a4b83-af0b-4538-bf67-519387da47c9 service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received event network-vif-unplugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-033f3eb1-53f7-48f7-906f-1de4ec16cdfa req-e50a4b83-af0b-4538-bf67-519387da47c9 service nova] Acquiring lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-033f3eb1-53f7-48f7-906f-1de4ec16cdfa req-e50a4b83-af0b-4538-bf67-519387da47c9 service nova] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-033f3eb1-53f7-48f7-906f-1de4ec16cdfa req-e50a4b83-af0b-4538-bf67-519387da47c9 service nova] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-033f3eb1-53f7-48f7-906f-1de4ec16cdfa req-e50a4b83-af0b-4538-bf67-519387da47c9 service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] No waiting events found dispatching network-vif-unplugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-033f3eb1-53f7-48f7-906f-1de4ec16cdfa req-e50a4b83-af0b-4538-bf67-519387da47c9 service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received event network-vif-unplugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:00 user nova-compute[76161]: INFO nova.compute.manager [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Terminating instance
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: INFO os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f5:88,bridge_name='br-int',has_traffic_filtering=True,id=dc4feb84-e8d8-471c-b343-9cc484201a86,network=Network(c533480a-7189-4c46-8ac1-fe59af3ad0ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4feb84-e8')
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=497ff416-9e25-4b65-915b-46b01d17e41f,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497ff416-9e') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=497ff416-9e25-4b65-915b-46b01d17e41f,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497ff416-9e') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap497ff416-9e, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Instance destroyed successfully.
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.objects.instance [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lazy-loading 'resources' on Instance uuid ef928bc3-c76d-48e2-ae04-8c3c06c42998 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-18353898',display_name='tempest-AttachSCSIVolumeTestJSON-server-18353898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-18353898',id=7,image_ref='efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0IXX9EB+eWtItPF129aDjF1MYbSgTb9nkfox3JmolLV/IbexL9fFNymYfyIasJbgYwADNKSnpuYgVOaNf10ARYTVFCgr0AtLrTdheaANRpmkjv9XAu4IdjbFqttDvfpg==',key_name='tempest-keypair-1560810522',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:49:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4b8c98bc4ae4aafb2686afe415fe44c',ramdisk_id='',reservation_id='r-nr304n70',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='efbfe2d0-fd22-485f-b5cd-ea4b09ef37ec',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1391122247',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1391122247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9339a85d862547ca978fd1e73fa031a3',uuid=ef928bc3-c76d-48e2-ae04-8c3c06c42998,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Converting VIF {"id": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "address": "fa:16:3e:80:74:d5", "network": {"id": "26b2ebf7-a6ae-4877-b2ae-bd352034f238", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-424061558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4b8c98bc4ae4aafb2686afe415fe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fbf12-df", "ovs_interfaceid": "7d1fbf12-dfd7-4d29-9975-6e9235084613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:74:d5,bridge_name='br-int',has_traffic_filtering=True,id=7d1fbf12-dfd7-4d29-9975-6e9235084613,network=Network(26b2ebf7-a6ae-4877-b2ae-bd352034f238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fbf12-df') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG os_vif [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:74:d5,bridge_name='br-int',has_traffic_filtering=True,id=7d1fbf12-dfd7-4d29-9975-6e9235084613,network=Network(26b2ebf7-a6ae-4877-b2ae-bd352034f238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fbf12-df') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d1fbf12-df, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:01 user nova-compute[76161]: WARNING nova.compute.manager [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-359d13b0-99ca-481b-a09e-f1d54046f9c8 for instance with vm_state active and task_state deleting.
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-unplugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-1fbe1540-c751-4b37-8229-1efba17d86a7 req-428adec1-e519-4b63-a786-19a05abbdcb9 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b9e1693-e9fa-47c3-b467-3ead66d65ab4) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8879a517-a790-493a-a51f-854be233460b) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: INFO os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:ba,bridge_name='br-int',has_traffic_filtering=True,id=497ff416-9e25-4b65-915b-46b01d17e41f,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap497ff416-9e')
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e6:90,bridge_name='br-int',has_traffic_filtering=True,id=359d13b0-99ca-481b-a09e-f1d54046f9c8,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap359d13b0-99') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e6:90,bridge_name='br-int',has_traffic_filtering=True,id=359d13b0-99ca-481b-a09e-f1d54046f9c8,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap359d13b0-99') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap359d13b0-99, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: INFO os_vif [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:74:d5,bridge_name='br-int',has_traffic_filtering=True,id=7d1fbf12-dfd7-4d29-9975-6e9235084613,network=Network(26b2ebf7-a6ae-4877-b2ae-bd352034f238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fbf12-df')
Nov 14 17:52:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Deleting instance files /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998_del
Nov 14 17:52:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Deletion of /opt/stack/data/nova/instances/ef928bc3-c76d-48e2-ae04-8c3c06c42998_del complete
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:02 user nova-compute[76161]: INFO nova.compute.manager [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Took 1.88 seconds to destroy the instance on the hypervisor.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: WARNING nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-ff41f832-98a2-4858-9afc-b6df0c638ed7 for instance with vm_state active and task_state deleting.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-unplugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: WARNING nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-e235037a-3ce6-4f04-a2f1-8e02958c47b9 for instance with vm_state active and task_state deleting.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-unplugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: WARNING nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-11a6406d-86f0-4ef2-8541-60f6ae8e5cef for instance with vm_state active and task_state deleting.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-unplugged-be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-unplugged-be8ed683-01f8-4816-a455-02a3e65a580e for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-plugged-be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "bc0af785-ac5b-4103-97e2-83285d9154da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] No waiting events found dispatching network-vif-plugged-be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: WARNING nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received unexpected event network-vif-plugged-be8ed683-01f8-4816-a455-02a3e65a580e for instance with vm_state active and task_state deleting.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-unplugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: WARNING nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-d6ff8d78-d459-4b93-9858-152428ce2cf9 for instance with vm_state active and task_state deleting.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-unplugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: WARNING nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-18f649cd-267b-41cf-a249-cec8fd1e6b4e for instance with vm_state active and task_state deleting.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-unplugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-57bdd77c-d63a-4dc3-b3f1-738578b6d254 req-5b1f2a11-9900-44db-8760-f01630997e93 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4a80399-485c-4d3a-8886-cd4b53f780e1) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Instance destroyed successfully.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.objects.instance [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lazy-loading 'resources' on Instance uuid 11cabda6-8cc9-481f-b91c-5fd359e98515 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=72a8f902-4304-40a0-ae7f-308ddf7e4956,network=Network(4a15a63f-c3cd-429d-b64a-85872fd8bd00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a8f902-43') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=72a8f902-4304-40a0-ae7f-308ddf7e4956,network=Network(4a15a63f-c3cd-429d-b64a-85872fd8bd00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a8f902-43') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72a8f902-43, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:02 user nova-compute[76161]: INFO os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e6:90,bridge_name='br-int',has_traffic_filtering=True,id=359d13b0-99ca-481b-a09e-f1d54046f9c8,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap359d13b0-99')
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=ff41f832-98a2-4858-9afc-b6df0c638ed7,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff41f832-98') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=ff41f832-98a2-4858-9afc-b6df0c638ed7,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff41f832-98') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff41f832-98, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fb8eb6d-d247-495a-815f-c6abd4c95fda) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received event network-vif-plugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Acquiring lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] No waiting events found dispatching network-vif-plugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: WARNING nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received unexpected event network-vif-plugged-7d1fbf12-dfd7-4d29-9975-6e9235084613 for instance with vm_state active and task_state deleting.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-unplugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: WARNING nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-72a8f902-4304-40a0-ae7f-308ddf7e4956 for instance with vm_state active and task_state deleting.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-unplugged-e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-e13e7508-0ac3-419f-b854-fb081e44aa65 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:02 user nova-compute[76161]: WARNING nova.compute.manager [req-1f1fb68c-f0ce-4bd1-8908-06b061dfee40 req-00c6db7a-1087-4353-b060-f535ecd8e6ea service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-e13e7508-0ac3-419f-b854-fb081e44aa65 for instance with vm_state active and task_state deleting.
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1ce16e9-aef1-4c8e-85b8-399f8cdd2546) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:02 user nova-compute[76161]: INFO os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:82:a8,bridge_name='br-int',has_traffic_filtering=True,id=72a8f902-4304-40a0-ae7f-308ddf7e4956,network=Network(4a15a63f-c3cd-429d-b64a-85872fd8bd00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a8f902-43')
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:6d:c4,bridge_name='br-int',has_traffic_filtering=True,id=d6ff8d78-d459-4b93-9858-152428ce2cf9,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6ff8d78-d4') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:6d:c4,bridge_name='br-int',has_traffic_filtering=True,id=d6ff8d78-d459-4b93-9858-152428ce2cf9,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6ff8d78-d4') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6ff8d78-d4, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Took 0.96 seconds to deallocate network for instance.
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: INFO os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ce:c4,bridge_name='br-int',has_traffic_filtering=True,id=ff41f832-98a2-4858-9afc-b6df0c638ed7,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff41f832-98')
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c3:b5,bridge_name='br-int',has_traffic_filtering=True,id=e235037a-3ce6-4f04-a2f1-8e02958c47b9,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape235037a-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c3:b5,bridge_name='br-int',has_traffic_filtering=True,id=e235037a-3ce6-4f04-a2f1-8e02958c47b9,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape235037a-3c') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape235037a-3c, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4be1b5e-8102-4bfe-b7fe-60a5a115e574) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27931cd2-7c70-410c-b199-e5db80c85ffb) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: INFO os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:6d:c4,bridge_name='br-int',has_traffic_filtering=True,id=d6ff8d78-d459-4b93-9858-152428ce2cf9,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6ff8d78-d4')
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:77:38,bridge_name='br-int',has_traffic_filtering=True,id=fbd5f82c-3c9c-4b63-807a-3af5841746a4,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbd5f82c-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:77:38,bridge_name='br-int',has_traffic_filtering=True,id=fbd5f82c-3c9c-4b63-807a-3af5841746a4,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbd5f82c-3c') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbd5f82c-3c, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: INFO os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c3:b5,bridge_name='br-int',has_traffic_filtering=True,id=e235037a-3ce6-4f04-a2f1-8e02958c47b9,network=Network(38710d2b-38b7-49df-86c3-84bc28e9a7a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape235037a-3c')
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:68:df,bridge_name='br-int',has_traffic_filtering=True,id=11a6406d-86f0-4ef2-8541-60f6ae8e5cef,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6406d-86') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:68:df,bridge_name='br-int',has_traffic_filtering=True,id=11a6406d-86f0-4ef2-8541-60f6ae8e5cef,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6406d-86') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11a6406d-86, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df4e3916-1054-48ec-85e1-8c280b9ea1da) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-af4c1f4c-07ed-4942-870b-982b07f60c35 req-779a6024-7599-4b2a-9955-afe98d3e7c4d service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-af4c1f4c-07ed-4942-870b-982b07f60c35 req-779a6024-7599-4b2a-9955-afe98d3e7c4d service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-af4c1f4c-07ed-4942-870b-982b07f60c35 req-779a6024-7599-4b2a-9955-afe98d3e7c4d service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-af4c1f4c-07ed-4942-870b-982b07f60c35 req-779a6024-7599-4b2a-9955-afe98d3e7c4d service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-af4c1f4c-07ed-4942-870b-982b07f60c35 req-779a6024-7599-4b2a-9955-afe98d3e7c4d service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:03 user nova-compute[76161]: WARNING nova.compute.manager [req-af4c1f4c-07ed-4942-870b-982b07f60c35 req-779a6024-7599-4b2a-9955-afe98d3e7c4d service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-fbd5f82c-3c9c-4b63-807a-3af5841746a4 for instance with vm_state active and task_state deleting.
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bc344a6-c5bc-4b20-adde-3e12ca21e77d) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: INFO os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:77:38,bridge_name='br-int',has_traffic_filtering=True,id=fbd5f82c-3c9c-4b63-807a-3af5841746a4,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbd5f82c-3c')
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "address": "fa:16:3e:ee:91:22", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18f649cd-26", "ovs_interfaceid": "18f649cd-267b-41cf-a249-cec8fd1e6b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:91:22,bridge_name='br-int',has_traffic_filtering=True,id=18f649cd-267b-41cf-a249-cec8fd1e6b4e,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f649cd-26') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:91:22,bridge_name='br-int',has_traffic_filtering=True,id=18f649cd-267b-41cf-a249-cec8fd1e6b4e,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f649cd-26') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18f649cd-26, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: INFO os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:68:df,bridge_name='br-int',has_traffic_filtering=True,id=11a6406d-86f0-4ef2-8541-60f6ae8e5cef,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a6406d-86')
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304144437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304144437',id=10,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpS7apYIYyhdHC+one+tXf5Shnd+b9DdtLuGMBxlDXj1ecDwCuhqBzgQxZXLjRfvadc3UsTn0jJVvdQAQ4Y7fHXGuGJwP8PcPcwl5ADQAsXLeEOJ22F2Hk/wasShn8sNg==',key_name='tempest-keypair-40011778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69a701f0dab64fc68396669c7ac14f9c',ramdisk_id='',reservation_id='r-mic2hvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-298283046',owner_user_name='tempest-TaggedBootDevicesTest_v242-298283046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='659819be1e544005b018b937d23fa6e9',uuid=bc0af785-ac5b-4103-97e2-83285d9154da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converting VIF {"id": "be8ed683-01f8-4816-a455-02a3e65a580e", "address": "fa:16:3e:2d:df:c2", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8ed683-01", "ovs_interfaceid": "be8ed683-01f8-4816-a455-02a3e65a580e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:c2,bridge_name='br-int',has_traffic_filtering=True,id=be8ed683-01f8-4816-a455-02a3e65a580e,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ed683-01') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:c2,bridge_name='br-int',has_traffic_filtering=True,id=be8ed683-01f8-4816-a455-02a3e65a580e,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ed683-01') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe8ed683-01, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44968902-d57c-4579-902a-b5f47ba64d36) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Deleted allocations for instance ef928bc3-c76d-48e2-ae04-8c3c06c42998
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8f4fc8c-747e-424b-878a-dc1dd83804e3) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: INFO os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:91:22,bridge_name='br-int',has_traffic_filtering=True,id=18f649cd-267b-41cf-a249-cec8fd1e6b4e,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18f649cd-26')
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:48:10,bridge_name='br-int',has_traffic_filtering=True,id=e13e7508-0ac3-419f-b854-fb081e44aa65,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13e7508-0a') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:48:10,bridge_name='br-int',has_traffic_filtering=True,id=e13e7508-0ac3-419f-b854-fb081e44aa65,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13e7508-0a') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape13e7508-0a, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: INFO os_vif [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:c2,bridge_name='br-int',has_traffic_filtering=True,id=be8ed683-01f8-4816-a455-02a3e65a580e,network=Network(0d13b1e7-df41-4c2c-a6d4-037f1b491cf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8ed683-01')
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iKUCubJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:03 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-37a1455a-d9b8-43cc-bc4c-5c2c7c0efdce tempest-AttachSCSIVolumeTestJSON-1391122247 tempest-AttachSCSIVolumeTestJSON-1391122247-project-member] Lock "ef928bc3-c76d-48e2-ae04-8c3c06c42998" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.501s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa1551fb-a2e1-46d3-bd77-eb6b738a5244) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc42b43-6f00-43a3-9ca6-a8b97ea21c92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:52:03 user nova-compute[76161]: No targets found.
Nov 14 17:52:03 user nova-compute[76161]: iSNS:
Nov 14 17:52:03 user nova-compute[76161]: No targets found.
Nov 14 17:52:03 user nova-compute[76161]: STATIC:
Nov 14 17:52:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:52:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:52:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f
Nov 14 17:52:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b
Nov 14 17:52:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c
Nov 14 17:52:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108
Nov 14 17:52:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed
Nov 14 17:52:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:03 user nova-compute[76161]: FIRMWARE:
Nov 14 17:52:03 user nova-compute[76161]: No targets found.
Nov 14 17:52:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:52:03 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:52:03 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: INFO os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:48:10,bridge_name='br-int',has_traffic_filtering=True,id=e13e7508-0ac3-419f-b854-fb081e44aa65,network=Network(f6f244a6-1942-4e63-be2c-9618dfc1e63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13e7508-0a')
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:b8,bridge_name='br-int',has_traffic_filtering=True,id=05b9f44c-73e6-40e5-afb5-96fd9a196210,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b9f44c-73') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:b8,bridge_name='br-int',has_traffic_filtering=True,id=05b9f44c-73e6-40e5-afb5-96fd9a196210,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b9f44c-73') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05b9f44c-73, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[62110dac-8b03-4c36-b29a-250a8414b2d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eef40709-b35b-4952-a46e-9137be98ebfa) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:03 user nova-compute[76161]: INFO os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:b8,bridge_name='br-int',has_traffic_filtering=True,id=05b9f44c-73e6-40e5-afb5-96fd9a196210,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05b9f44c-73')
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1298780162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1298780162',id=11,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFy/bfc+nrWNH0qnF3o+R11FPucUzyuVzZ1B178LXKt4wenGTFHZ3xCr34eYXVNoBwzGN3AwzErWK2ORuijERX0WaBjHFq+HuIGs31htTYH4q3HamvSXITdL/dFjJyJkA==',key_name='tempest-keypair-1873660148',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db46f69a7d5c4578b58c89fd04bfe824',ramdisk_id='',reservation_id='r-qrsgycni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1442842885',owner_user_name='tempest-TaggedBootDevicesTest-1442842885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f032554742874fd1b86a0a9019c4418c',uuid=11cabda6-8cc9-481f-b91c-5fd359e98515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converting VIF {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:35:17,bridge_name='br-int',has_traffic_filtering=True,id=4ee1239f-391c-4006-af98-3beaffe581bc,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1239f-39') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:35:17,bridge_name='br-int',has_traffic_filtering=True,id=4ee1239f-391c-4006-af98-3beaffe581bc,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1239f-39') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0a9034-f408-47b2-8b31-a0107e6fb7bf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 (non-flash)
Nov 14 17:52:03 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f03b3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108'): ({'sdg'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Removing single pathed devices sdg {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ee1239f-39, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a14cce3-2fb0-48e6-81d9-cdf69635f8f8) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:03 user nova-compute[76161]: INFO os_vif [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:35:17,bridge_name='br-int',has_traffic_filtering=True,id=4ee1239f-391c-4006-af98-3beaffe581bc,network=Network(305343bf-344f-4f69-9fe9-5104791abcab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1239f-39')
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrxhpytl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:03 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7c0573-1306-415a-9dbf-b306137f3a39]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e44892-ab29-4bfa-8e42-0ca78e67a20c]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Flushing IO for device /dev/sdg {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b775dc-2ce7-464d-b12c-2168f39498db]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:03 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b45e1ad6-d346-442e-a957-9398103b143f is timed out.
Nov 14 17:52:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Successfully detached device vdb from instance b45e1ad6-d346-442e-a957-9398103b143f from the live domain config.
Nov 14 17:52:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] [instance: b45e1ad6-d346-442e-a957-9398103b143f] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVJoLyHA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:03 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bdb759-25fa-4c87-9aed-935a28baf03d]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] SCSI volumes sdg have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6178263-5c51-4f7b-900e-0bce9d320f99]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5adf747-7dd1-464d-ac67-e26a701834c5]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108, portal: 172.16.0.220,3260]
Nov 14 17:52:04 user nova-compute[76161]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b10766f-5218-4d44-b0ed-153e34460108 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b7ac02-dbb4-404a-b38d-d421265ca422]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] <== disconnect_volume: return (316ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.206s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPSeCwAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:04 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[766814f4-0315-485b-be12-0e672959ccee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:52:04 user nova-compute[76161]: No targets found.
Nov 14 17:52:04 user nova-compute[76161]: iSNS:
Nov 14 17:52:04 user nova-compute[76161]: No targets found.
Nov 14 17:52:04 user nova-compute[76161]: STATIC:
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: FIRMWARE:
Nov 14 17:52:04 user nova-compute[76161]: No targets found.
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:52:04 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:52:04 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f576b8b0-549b-481e-825e-c23ed670bc15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf6459f-d16f-48d4-8167-f600a0e754d5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0283910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b'): ({'sdf'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Removing single pathed devices sdf {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62b5c39-c47c-4612-aad0-41fa4563a67b]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[331d69df-d5ab-48f0-9058-20fe05d6c953]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Flushing IO for device /dev/sdf {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da81028-b85c-489e-9570-800e42285c16]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b422a-7430-4f47-9340-c10b47eebb2a]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:04 user nova-compute[76161]: WARNING nova.compute.manager [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-05b9f44c-73e6-40e5-afb5-96fd9a196210 for instance with vm_state active and task_state deleting.
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-unplugged-4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-unplugged-4ee1239f-391c-4006-af98-3beaffe581bc for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-plugged-4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] Acquiring lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] No waiting events found dispatching network-vif-plugged-4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:04 user nova-compute[76161]: WARNING nova.compute.manager [req-bba54a11-7acc-438e-9fa9-12a227c46ffa req-4f6b9a6f-25cb-480c-9b85-0fbc35b42187 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received unexpected event network-vif-plugged-4ee1239f-391c-4006-af98-3beaffe581bc for instance with vm_state active and task_state deleting.
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[092f538f-e8d6-48a9-91cd-cb8be366be3b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f448c055-8e02-4fb5-a22c-539ecdfe72b4]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b, portal: 172.16.0.220,3260]
Nov 14 17:52:04 user nova-compute[76161]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6327b23e-67c0-46fe-9ce5-45f61c584d5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e31acc8-c431-4367-b6d4-1cc8ea523638]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] <== disconnect_volume: return (534ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.477s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KgzIUnEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:04 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[06332ee2-2e95-462d-8e2d-575e11ca42ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:52:04 user nova-compute[76161]: No targets found.
Nov 14 17:52:04 user nova-compute[76161]: iSNS:
Nov 14 17:52:04 user nova-compute[76161]: No targets found.
Nov 14 17:52:04 user nova-compute[76161]: STATIC:
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: FIRMWARE:
Nov 14 17:52:04 user nova-compute[76161]: No targets found.
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:52:04 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:52:04 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3627b86c-3e95-4063-940e-13f67b136159]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[024e98b0-5bd0-40fe-ba02-9b99c6eb9310]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f013aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c'): ({'sdk'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Removing single pathed devices sdk {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd04dd1-77bb-4267-bc44-250f4c1d065d]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:52:04 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Creating image(s)
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Ensure instance console log exists: /opt/stack/data/nova/instances/32fb9960-faa6-443a-88d3-3ee3c68b27fe/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Start _get_guest_xml network_info=[{"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqZhQwgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32fb9960-faa6-443a-88d3-3ee3c68b27fe', 'attached_at': '', 'detached_at': '', 'volume_id': 'c755112f-0941-40de-a17b-9d0c182004dc', 'serial': 'c755112f-0941-40de-a17b-9d0c182004dc'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '447da306-80c6-4123-a0bf-e54b194abefb', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:52:04 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 17:52:04 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e874025-92a2-4749-8fb5-b94ae5a7e2f8]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Flushing IO for device /dev/sdk {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.objects.instance [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lazy-loading 'vcpu_model' on Instance uuid 32fb9960-faa6-443a-88d3-3ee3c68b27fe {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe9a49b-1d81-4f56-a855-94bdda241006]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqZhQwgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:04 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.043s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fc7df1-cce1-4b7b-ae1e-5eb0a58648ae]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] SCSI volumes sdk have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d97c43-10fe-45fc-8178-5fef083ae1e5]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1f9791-7af9-444e-8ee2-48ea11b27d1d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c, portal: 172.16.0.220,3260]
Nov 14 17:52:04 user nova-compute[76161]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad99e6a7-4903-4306-a5cd-0c3f9ac3a99c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[254c9a5c-2928-4fc6-85b9-41f8884da005]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] <== disconnect_volume: return (793ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.647s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b866e2-6175-4a20-bfb3-fec47a575c2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:52:04 user nova-compute[76161]: No targets found.
Nov 14 17:52:04 user nova-compute[76161]: iSNS:
Nov 14 17:52:04 user nova-compute[76161]: No targets found.
Nov 14 17:52:04 user nova-compute[76161]: STATIC:
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed
Nov 14 17:52:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:04 user nova-compute[76161]: FIRMWARE:
Nov 14 17:52:04 user nova-compute[76161]: No targets found.
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:52:04 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:52:04 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145c616-0c21-4d38-8457-bd54f12a4ce8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c3fa85-9ef5-4d40-a761-1b55a38dadb6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f (non-flash)
Nov 14 17:52:04 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f82fcc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f'): ({'sde'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Removing single pathed devices sde {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[19062128-233c-41ac-abd9-5ed3bd8d3be9]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7affa90e-793d-48c6-8ed8-3cd609a44289]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Flushing IO for device /dev/sde {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcb6025-a57b-42f4-8f49-41992020a94a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2101b3-79fe-4849-86da-6fbeabe02c1c]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ba2e00-7918-49b9-90d7-a13deff596fa]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-2aa7d214-bb13-4ea8-bab2-08b82de92110 req-c4e9857f-69de-4976-a8cd-6982c4b603d5 service nova] [instance: ef928bc3-c76d-48e2-ae04-8c3c06c42998] Received event network-vif-deleted-7d1fbf12-dfd7-4d29-9975-6e9235084613 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dbc1d1-278e-4671-8702-fe7b0463d400]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f, portal: 172.16.0.220,3260]
Nov 14 17:52:04 user nova-compute[76161]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d59719bd-db14-446f-8481-c70f6f2acb2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6c6655-dd4a-40a2-a3db-787b52ae7a40]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] <== disconnect_volume: return (936ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.606s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNTARMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:05 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3d0267-b8e5-422b-aaac-669ba1f26eb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:52:05 user nova-compute[76161]: No targets found.
Nov 14 17:52:05 user nova-compute[76161]: iSNS:
Nov 14 17:52:05 user nova-compute[76161]: No targets found.
Nov 14 17:52:05 user nova-compute[76161]: STATIC:
Nov 14 17:52:05 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:52:05 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:05 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:05 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:52:05 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:05 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:05 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed
Nov 14 17:52:05 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:05 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:05 user nova-compute[76161]: FIRMWARE:
Nov 14 17:52:05 user nova-compute[76161]: No targets found.
Nov 14 17:52:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:52:05 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:52:05 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8cb260-eb81-4331-815c-a71cb70caa6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed3249c-f5a5-4509-83ec-8911cf2c6e22]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:52:05 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed (non-flash)
Nov 14 17:52:05 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f82fcc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed'): ({'sdd'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Removing single pathed devices sdd {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ff26d9-b44f-4367-a65f-be604e60a024]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa7f7bf-3d6f-472c-8614-e91b89407485]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Flushing IO for device /dev/sdd {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad647851-0ca8-4c8a-a898-e4b1e752e48b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4680229-84bc-488d-8036-8656faeabaf1]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] SCSI volumes sdd have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a22849-c423-4959-afd3-e168f8738b38]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baed0df-4a31-4647-af52-e0373368d6fa]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed, portal: 172.16.0.220,3260]
Nov 14 17:52:05 user nova-compute[76161]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a025f514-8a66-4a0a-a24f-f3023cb869ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[348dfdd1-f543-4c7c-9f8a-5caa52e96ead]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] <== disconnect_volume: return (881ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.700s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:05 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:05 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqWbZGgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:05 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0096ab5-c608-48f7-9d8d-1808f97e9691]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:52:05 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[26795a86-8df8-4307-9b95-01cfa6aae8b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc] added
Nov 14 17:52:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf3f132-1c4b-4fae-80b9-b95039618441]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6402cc3f-4bf1-42b9-9005-fab064da80a8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqZhQwgO {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqZhQwgO" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b587e29-aa62-4be5-b8fd-da6e16d6240c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oqZhQwgO'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7da0172-ed7c-4527-86cb-ee59101abda9]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eaa392-3490-4eda-afa1-6d64450fa913]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6601ea-d10b-45a0-b917-38b684afe16a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260]
Nov 14 17:52:05 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG nova.objects.instance [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lazy-loading 'flavor' on Instance uuid b45e1ad6-d346-442e-a957-9398103b143f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ad9fd4-435d-436a-870e-80debec4e5ab]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5d96a6-77d1-46b3-81b3-1c88927c2627]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:05 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:05 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2bee7b-9e8f-4c24-b6e8-4308c4dee9ee]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqZhQwgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:52:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-85f7df73-3964-4e58-a518-ab8dfbd60269 tempest-VolumesAssistedSnapshotsTest-684029332 tempest-VolumesAssistedSnapshotsTest-684029332-project-admin] Lock "b45e1ad6-d346-442e-a957-9398103b143f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.207s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] <== connect_volume: return (2005ms) {'type': 'block', 'scsi_wwn': '23434346364306562', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434346364306562', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.580s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[953c47f4-0a14-43b4-854f-4272daf0bdc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:52:06 user nova-compute[76161]: No targets found.
Nov 14 17:52:06 user nova-compute[76161]: iSNS:
Nov 14 17:52:06 user nova-compute[76161]: No targets found.
Nov 14 17:52:06 user nova-compute[76161]: STATIC:
Nov 14 17:52:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc
Nov 14 17:52:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:52:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8
Nov 14 17:52:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:06 user nova-compute[76161]: FIRMWARE:
Nov 14 17:52:06 user nova-compute[76161]: No targets found.
Nov 14 17:52:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:52:06 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:52:06 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-655941733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-666366678',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0qfeGCNZ8gGzIgerfVDfT/REFNEKBmHXss/bGsLZbbzc6KURhywrEepQWnmaphwMEjeaXsblW4CfozsJdXaIg0LiAQIBG9pM3LmTWPAIyPcUriJ85J0I8eim3SdheLFg==',key_name='tempest-keypair-279762098',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1801c743af0c4de098b6f24fd98c3d89',ramdisk_id='',reservation_id='r-pg3zw022',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1345728502',owner_user_name='tempest-ServerActionsV293TestJSON-1345728502-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:51:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e682032e8b74286b9cc47624f3f4ae0',uuid=32fb9960-faa6-443a-88d3-3ee3c68b27fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converting VIF {"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:52:06 user nova-compute[76161]:   <uuid>32fb9960-faa6-443a-88d3-3ee3c68b27fe</uuid>
Nov 14 17:52:06 user nova-compute[76161]:   <name>instance-00000009</name>
Nov 14 17:52:06 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:52:06 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:52:06 user nova-compute[76161]:   <metadata>
Nov 14 17:52:06 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:52:06 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:52:06 user nova-compute[76161]:       <nova:name>tempest-ServerActionsV293TestJSON-server-655941733</nova:name>
Nov 14 17:52:06 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:52:04</nova:creationTime>
Nov 14 17:52:06 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:52:06 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:52:06 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:52:06 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:52:06 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:52:06 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:52:06 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:52:06 user nova-compute[76161]:       <nova:owner>
Nov 14 17:52:06 user nova-compute[76161]:         <nova:user uuid="5e682032e8b74286b9cc47624f3f4ae0">tempest-ServerActionsV293TestJSON-1345728502-project-member</nova:user>
Nov 14 17:52:06 user nova-compute[76161]:         <nova:project uuid="1801c743af0c4de098b6f24fd98c3d89">tempest-ServerActionsV293TestJSON-1345728502</nova:project>
Nov 14 17:52:06 user nova-compute[76161]:       </nova:owner>
Nov 14 17:52:06 user nova-compute[76161]:       <nova:ports>
Nov 14 17:52:06 user nova-compute[76161]:         <nova:port uuid="8180a18a-275a-422b-bc71-e1846af90d29">
Nov 14 17:52:06 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 17:52:06 user nova-compute[76161]:         </nova:port>
Nov 14 17:52:06 user nova-compute[76161]:       </nova:ports>
Nov 14 17:52:06 user nova-compute[76161]:     </nova:instance>
Nov 14 17:52:06 user nova-compute[76161]:   </metadata>
Nov 14 17:52:06 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:52:06 user nova-compute[76161]:     <system>
Nov 14 17:52:06 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:52:06 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:52:06 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:52:06 user nova-compute[76161]:       <entry name="serial">32fb9960-faa6-443a-88d3-3ee3c68b27fe</entry>
Nov 14 17:52:06 user nova-compute[76161]:       <entry name="uuid">32fb9960-faa6-443a-88d3-3ee3c68b27fe</entry>
Nov 14 17:52:06 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:52:06 user nova-compute[76161]:     </system>
Nov 14 17:52:06 user nova-compute[76161]:   </sysinfo>
Nov 14 17:52:06 user nova-compute[76161]:   <os>
Nov 14 17:52:06 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:52:06 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:52:06 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:52:06 user nova-compute[76161]:   </os>
Nov 14 17:52:06 user nova-compute[76161]:   <features>
Nov 14 17:52:06 user nova-compute[76161]:     <acpi/>
Nov 14 17:52:06 user nova-compute[76161]:     <apic/>
Nov 14 17:52:06 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:52:06 user nova-compute[76161]:   </features>
Nov 14 17:52:06 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:52:06 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:52:06 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:52:06 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:52:06 user nova-compute[76161]:   </clock>
Nov 14 17:52:06 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:52:06 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:52:06 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:52:06 user nova-compute[76161]:   </cpu>
Nov 14 17:52:06 user nova-compute[76161]:   <devices>
Nov 14 17:52:06 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:52:06 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:52:06 user nova-compute[76161]:       <source dev="/dev/sdb"/>
Nov 14 17:52:06 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:52:06 user nova-compute[76161]:       <serial>c755112f-0941-40de-a17b-9d0c182004dc</serial>
Nov 14 17:52:06 user nova-compute[76161]:     </disk>
Nov 14 17:52:06 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:52:06 user nova-compute[76161]:       <mac address="fa:16:3e:26:2c:18"/>
Nov 14 17:52:06 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:52:06 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:52:06 user nova-compute[76161]:       <target dev="tap8180a18a-27"/>
Nov 14 17:52:06 user nova-compute[76161]:     </interface>
Nov 14 17:52:06 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:52:06 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/32fb9960-faa6-443a-88d3-3ee3c68b27fe/console.log" append="off"/>
Nov 14 17:52:06 user nova-compute[76161]:     </serial>
Nov 14 17:52:06 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:52:06 user nova-compute[76161]:     <video>
Nov 14 17:52:06 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:52:06 user nova-compute[76161]:     </video>
Nov 14 17:52:06 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:52:06 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:52:06 user nova-compute[76161]:     </rng>
Nov 14 17:52:06 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:52:06 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:52:06 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:52:06 user nova-compute[76161]:     </memballoon>
Nov 14 17:52:06 user nova-compute[76161]:   </devices>
Nov 14 17:52:06 user nova-compute[76161]: </domain>
Nov 14 17:52:06 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-655941733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-666366678',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0qfeGCNZ8gGzIgerfVDfT/REFNEKBmHXss/bGsLZbbzc6KURhywrEepQWnmaphwMEjeaXsblW4CfozsJdXaIg0LiAQIBG9pM3LmTWPAIyPcUriJ85J0I8eim3SdheLFg==',key_name='tempest-keypair-279762098',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1801c743af0c4de098b6f24fd98c3d89',ramdisk_id='',reservation_id='r-pg3zw022',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1345728502',owner_user_name='tempest-ServerActionsV293TestJSON-1345728502-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:51:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e682032e8b74286b9cc47624f3f4ae0',uuid=32fb9960-faa6-443a-88d3-3ee3c68b27fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converting VIF {"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_vif [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd505f9e-d669-5077-b888-78e7baebebe8', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8180a18a-27, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8180a18a-27, col_values=(('qos', UUID('001265b7-2f09-4368-9b34-1fff4519be8d')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8180a18a-27, col_values=(('external_ids', {'iface-id': '8180a18a-275a-422b-bc71-e1846af90d29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:2c:18', 'vm-uuid': '32fb9960-faa6-443a-88d3-3ee3c68b27fe'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[206b9eeb-b48c-44bf-85bf-1e8d4cbf9365]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:06 user nova-compute[76161]: INFO os_vif [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27')
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[175df810-1495-401d-994e-a23ae6fcc5fd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:06 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:06 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:06 user nova-compute[76161]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 (non-flash)
Nov 14 17:52:06 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0138c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b2a6dc-a7e5-4845-94ba-0c9ed751928c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] No VIF found with MAC fa:16:3e:26:2c:18, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e615f4-37f2-4300-810e-4b1a3aeb1d83]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb829d5f-fa98-405e-8eac-e037612c3b1c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b037cef-576e-4360-b893-19d9904fa0f5]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fb1c17-6d95-4f64-8437-54be8aae81db]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e02e6b-1e08-45e4-8858-0112c5d00764]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8, portal: 172.16.0.220,3260]
Nov 14 17:52:06 user nova-compute[76161]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcdf194-0478-45fa-8da0-9a1aa69238f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20e9b54-cdad-45fb-a20e-f89e9fa4dc89]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] <== disconnect_volume: return (1905ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:52:06 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Deleting instance files /opt/stack/data/nova/instances/bc0af785-ac5b-4103-97e2-83285d9154da_del
Nov 14 17:52:06 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Deletion of /opt/stack/data/nova/instances/bc0af785-ac5b-4103-97e2-83285d9154da_del complete
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.632s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b268162a-bbe0-48db-ac0c-5eec3a8827e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:52:06 user nova-compute[76161]: No targets found.
Nov 14 17:52:06 user nova-compute[76161]: iSNS:
Nov 14 17:52:06 user nova-compute[76161]: No targets found.
Nov 14 17:52:06 user nova-compute[76161]: STATIC:
Nov 14 17:52:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc
Nov 14 17:52:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3
Nov 14 17:52:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:06 user nova-compute[76161]: FIRMWARE:
Nov 14 17:52:06 user nova-compute[76161]: No targets found.
Nov 14 17:52:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:52:06 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:52:06 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d9ff69-1f2c-4646-b6d6-be96f1f33439]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:06 user nova-compute[76161]: INFO nova.compute.manager [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Took 8.19 seconds to destroy the instance on the hypervisor.
Nov 14 17:52:06 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:52:06 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ef2afe-f3a9-4503-82a5-55e17441004e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:07 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:07 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:07 user nova-compute[76161]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 (non-flash)
Nov 14 17:52:07 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f03b3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3'): ({'sdh'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Removing single pathed devices sdh {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ce2953-5ee0-44f4-8eb3-ebb37a0a941d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[282a902e-ccde-4ee2-92b1-794d22fde7da]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Flushing IO for device /dev/sdh {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc2529-7839-4e0f-8df1-e411e120097b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.036s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e451eae3-3baa-4e39-ac11-de8b3ca1fd0c]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] SCSI volumes sdh have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f40ca-7581-45a5-b5ad-00fd0b746b7f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c771fc7e-5fbe-49cb-8f74-8abab2eec6bb]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3, portal: 172.16.0.220,3260]
Nov 14 17:52:07 user nova-compute[76161]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:07 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8f2c208-12e7-4583-ac16-15a172993fd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ede733-21f2-48a5-ab68-5433913f6998]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] <== disconnect_volume: return (1912ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:52:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Deleting instance files /opt/stack/data/nova/instances/11cabda6-8cc9-481f-b91c-5fd359e98515_del
Nov 14 17:52:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Deletion of /opt/stack/data/nova/instances/11cabda6-8cc9-481f-b91c-5fd359e98515_del complete
Nov 14 17:52:07 user nova-compute[76161]: INFO nova.compute.manager [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Took 6.46 seconds to destroy the instance on the hypervisor.
Nov 14 17:52:07 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-99f45a68-4a59-497b-831b-f0235e8c0ab4 req-7c153b52-05c2-4858-a243-4e921c062493 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-99f45a68-4a59-497b-831b-f0235e8c0ab4 req-7c153b52-05c2-4858-a243-4e921c062493 service nova] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-99f45a68-4a59-497b-831b-f0235e8c0ab4 req-7c153b52-05c2-4858-a243-4e921c062493 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-99f45a68-4a59-497b-831b-f0235e8c0ab4 req-7c153b52-05c2-4858-a243-4e921c062493 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-99f45a68-4a59-497b-831b-f0235e8c0ab4 req-7c153b52-05c2-4858-a243-4e921c062493 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] No waiting events found dispatching network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:08 user nova-compute[76161]: WARNING nova.compute.manager [req-99f45a68-4a59-497b-831b-f0235e8c0ab4 req-7c153b52-05c2-4858-a243-4e921c062493 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received unexpected event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 17:52:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-a5d72822-4215-4489-9e0c-cb92923a1a9b req-064a64f5-32f4-4537-b252-3fd87211adbc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-deleted-be8ed683-01f8-4816-a455-02a3e65a580e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:08 user nova-compute[76161]: INFO nova.compute.manager [req-a5d72822-4215-4489-9e0c-cb92923a1a9b req-064a64f5-32f4-4537-b252-3fd87211adbc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Neutron deleted interface be8ed683-01f8-4816-a455-02a3e65a580e; detaching it from the instance and deleting it from the info cache
Nov 14 17:52:08 user nova-compute[76161]: DEBUG nova.network.neutron [req-a5d72822-4215-4489-9e0c-cb92923a1a9b req-064a64f5-32f4-4537-b252-3fd87211adbc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [{"id": "dc4feb84-e8d8-471c-b343-9cc484201a86", "address": "fa:16:3e:0d:f5:88", "network": {"id": "c533480a-7189-4c46-8ac1-fe59af3ad0ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1853131295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4feb84-e8", "ovs_interfaceid": "dc4feb84-e8d8-471c-b343-9cc484201a86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "497ff416-9e25-4b65-915b-46b01d17e41f", "address": "fa:16:3e:06:13:ba", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap497ff416-9e", "ovs_interfaceid": "497ff416-9e25-4b65-915b-46b01d17e41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "address": "fa:16:3e:ee:e6:90", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359d13b0-99", "ovs_interfaceid": "359d13b0-99ca-481b-a09e-f1d54046f9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "address": "fa:16:3e:8b:ce:c4", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff41f832-98", "ovs_interfaceid": "ff41f832-98a2-4858-9afc-b6df0c638ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "address": "fa:16:3e:16:c3:b5", "network": {"id": "38710d2b-38b7-49df-86c3-84bc28e9a7a2", "bridge": "br-int", "label": "tempest-device-tagging-net1-329004967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape235037a-3c", "ovs_interfaceid": "e235037a-3ce6-4f04-a2f1-8e02958c47b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "address": "fa:16:3e:4e:68:df", "network": {"id": "0d13b1e7-df41-4c2c-a6d4-037f1b491cf3", "bridge": "br-int", "label": "tempest-device-tagging-net2-523811287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "69a701f0dab64fc68396669c7ac14f9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a6406d-86", "ovs_interfaceid": "11a6406d-86f0-4ef2-8541-60f6ae8e5cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-a5d72822-4215-4489-9e0c-cb92923a1a9b req-064a64f5-32f4-4537-b252-3fd87211adbc service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Detach interface failed, port_id=be8ed683-01f8-4816-a455-02a3e65a580e, reason: Instance bc0af785-ac5b-4103-97e2-83285d9154da could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:52:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-71a4751c-b71a-42a3-8956-e1b86a965b14 req-0f59a9ac-6458-460c-9dea-e38afbdd040c service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-deleted-18f649cd-267b-41cf-a249-cec8fd1e6b4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:09 user nova-compute[76161]: INFO nova.compute.manager [req-71a4751c-b71a-42a3-8956-e1b86a965b14 req-0f59a9ac-6458-460c-9dea-e38afbdd040c service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Neutron deleted interface 18f649cd-267b-41cf-a249-cec8fd1e6b4e; detaching it from the instance and deleting it from the info cache
Nov 14 17:52:09 user nova-compute[76161]: DEBUG nova.network.neutron [req-71a4751c-b71a-42a3-8956-e1b86a965b14 req-0f59a9ac-6458-460c-9dea-e38afbdd040c service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [{"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "address": "fa:16:3e:1b:58:b8", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05b9f44c-73", "ovs_interfaceid": "05b9f44c-73e6-40e5-afb5-96fd9a196210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-71a4751c-b71a-42a3-8956-e1b86a965b14 req-0f59a9ac-6458-460c-9dea-e38afbdd040c service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Detach interface failed, port_id=18f649cd-267b-41cf-a249-cec8fd1e6b4e, reason: Instance 11cabda6-8cc9-481f-b91c-5fd359e98515 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:52:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:52:10 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Instance spawned successfully.
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:10 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Took 3.33 seconds to deallocate network for instance.
Nov 14 17:52:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.objects.instance [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Trying to apply a migration context that does not seem to be set for this instance {{(pid=76161) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-bc86f4d9-2996-4e38-89fb-d9d23a59e059 req-b6c46d50-1a90-4a98-a1d4-4167e7ae91aa service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bc86f4d9-2996-4e38-89fb-d9d23a59e059 req-b6c46d50-1a90-4a98-a1d4-4167e7ae91aa service nova] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bc86f4d9-2996-4e38-89fb-d9d23a59e059 req-b6c46d50-1a90-4a98-a1d4-4167e7ae91aa service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bc86f4d9-2996-4e38-89fb-d9d23a59e059 req-b6c46d50-1a90-4a98-a1d4-4167e7ae91aa service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-bc86f4d9-2996-4e38-89fb-d9d23a59e059 req-b6c46d50-1a90-4a98-a1d4-4167e7ae91aa service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] No waiting events found dispatching network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:10 user nova-compute[76161]: WARNING nova.compute.manager [req-bc86f4d9-2996-4e38-89fb-d9d23a59e059 req-b6c46d50-1a90-4a98-a1d4-4167e7ae91aa service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received unexpected event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 for instance with vm_state active and task_state None.
Nov 14 17:52:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-76b8f308-b165-454c-bf99-00a20b7867f2 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-5585229d-b188-4730-a7f8-847c47b9b53a req-300c1c31-f9a7-4f60-ab55-219d817e6ead service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-deleted-e235037a-3ce6-4f04-a2f1-8e02958c47b9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-5585229d-b188-4730-a7f8-847c47b9b53a req-300c1c31-f9a7-4f60-ab55-219d817e6ead service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-deleted-ff41f832-98a2-4858-9afc-b6df0c638ed7 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-5585229d-b188-4730-a7f8-847c47b9b53a req-300c1c31-f9a7-4f60-ab55-219d817e6ead service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-deleted-11a6406d-86f0-4ef2-8541-60f6ae8e5cef {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-5585229d-b188-4730-a7f8-847c47b9b53a req-300c1c31-f9a7-4f60-ab55-219d817e6ead service nova] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Received event network-vif-deleted-dc4feb84-e8d8-471c-b343-9cc484201a86 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-deleted-05b9f44c-73e6-40e5-afb5-96fd9a196210 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:11 user nova-compute[76161]: INFO nova.compute.manager [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Neutron deleted interface 05b9f44c-73e6-40e5-afb5-96fd9a196210; detaching it from the instance and deleting it from the info cache
Nov 14 17:52:11 user nova-compute[76161]: DEBUG nova.network.neutron [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [{"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e13e7508-0ac3-419f-b854-fb081e44aa65", "address": "fa:16:3e:b9:48:10", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13e7508-0a", "ovs_interfaceid": "e13e7508-0ac3-419f-b854-fb081e44aa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Detach interface failed, port_id=05b9f44c-73e6-40e5-afb5-96fd9a196210, reason: Instance 11cabda6-8cc9-481f-b91c-5fd359e98515 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:52:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-deleted-e13e7508-0ac3-419f-b854-fb081e44aa65 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:11 user nova-compute[76161]: INFO nova.compute.manager [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Neutron deleted interface e13e7508-0ac3-419f-b854-fb081e44aa65; detaching it from the instance and deleting it from the info cache
Nov 14 17:52:11 user nova-compute[76161]: DEBUG nova.network.neutron [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [{"id": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "address": "fa:16:3e:c2:82:a8", "network": {"id": "4a15a63f-c3cd-429d-b64a-85872fd8bd00", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-864326568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a8f902-43", "ovs_interfaceid": "72a8f902-4304-40a0-ae7f-308ddf7e4956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:11 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Detach interface failed, port_id=e13e7508-0ac3-419f-b854-fb081e44aa65, reason: Instance 11cabda6-8cc9-481f-b91c-5fd359e98515 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:52:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-deleted-72a8f902-4304-40a0-ae7f-308ddf7e4956 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:11 user nova-compute[76161]: INFO nova.compute.manager [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Neutron deleted interface 72a8f902-4304-40a0-ae7f-308ddf7e4956; detaching it from the instance and deleting it from the info cache
Nov 14 17:52:11 user nova-compute[76161]: DEBUG nova.network.neutron [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [{"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ee1239f-391c-4006-af98-3beaffe581bc", "address": "fa:16:3e:ae:35:17", "network": {"id": "305343bf-344f-4f69-9fe9-5104791abcab", "bridge": "br-int", "label": "tempest-device-tagging-net2-398670778", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1239f-39", "ovs_interfaceid": "4ee1239f-391c-4006-af98-3beaffe581bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:11 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Took 4.58 seconds to deallocate network for instance.
Nov 14 17:52:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-4cf58b8f-1e18-4552-b0fa-8c7291376049 req-c9f25f5c-ebb2-4354-b3ee-802f9fdecc02 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Detach interface failed, port_id=72a8f902-4304-40a0-ae7f-308ddf7e4956, reason: Instance 11cabda6-8cc9-481f-b91c-5fd359e98515 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:52:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:13 user nova-compute[76161]: INFO nova.compute.manager [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] [instance: bc0af785-ac5b-4103-97e2-83285d9154da] Took 2.94 seconds to detach 3 volumes for instance.
Nov 14 17:52:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:13 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:52:13 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:52:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-6e889d8c-fbb1-4704-81ce-2d0098df58de req-a986e8a9-719b-471c-99ff-937a37135c36 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Received event network-vif-deleted-4ee1239f-391c-4006-af98-3beaffe581bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:13 user nova-compute[76161]: INFO nova.compute.manager [req-6e889d8c-fbb1-4704-81ce-2d0098df58de req-a986e8a9-719b-471c-99ff-937a37135c36 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Neutron deleted interface 4ee1239f-391c-4006-af98-3beaffe581bc; detaching it from the instance and deleting it from the info cache
Nov 14 17:52:13 user nova-compute[76161]: DEBUG nova.network.neutron [req-6e889d8c-fbb1-4704-81ce-2d0098df58de req-a986e8a9-719b-471c-99ff-937a37135c36 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Updating instance_info_cache with network_info: [{"id": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "address": "fa:16:3e:d7:6d:c4", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ff8d78-d4", "ovs_interfaceid": "d6ff8d78-d459-4b93-9858-152428ce2cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "address": "fa:16:3e:1b:77:38", "network": {"id": "f6f244a6-1942-4e63-be2c-9618dfc1e63d", "bridge": "br-int", "label": "tempest-device-tagging-net1-484271345", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "db46f69a7d5c4578b58c89fd04bfe824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd5f82c-3c", "ovs_interfaceid": "fbd5f82c-3c9c-4b63-807a-3af5841746a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-6e889d8c-fbb1-4704-81ce-2d0098df58de req-a986e8a9-719b-471c-99ff-937a37135c36 service nova] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Detach interface failed, port_id=4ee1239f-391c-4006-af98-3beaffe581bc, reason: Instance 11cabda6-8cc9-481f-b91c-5fd359e98515 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:52:13 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Deleted allocations for instance bc0af785-ac5b-4103-97e2-83285d9154da
Nov 14 17:52:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:52:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dc83a43f-d0e6-4ce6-8541-9372d02272a0 tempest-TaggedBootDevicesTest_v242-298283046 tempest-TaggedBootDevicesTest_v242-298283046-project-member] Lock "bc0af785-ac5b-4103-97e2-83285d9154da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.168s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:52:14 user nova-compute[76161]: INFO nova.compute.claims [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Claim successful on node user
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-77c48b40-1904-41ab-a9b9-cc929cd1e1fc req-c734b220-abe2-4a4f-af9b-7790af38bced service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received event network-changed-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-77c48b40-1904-41ab-a9b9-cc929cd1e1fc req-c734b220-abe2-4a4f-af9b-7790af38bced service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Refreshing instance network info cache due to event network-changed-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-77c48b40-1904-41ab-a9b9-cc929cd1e1fc req-c734b220-abe2-4a4f-af9b-7790af38bced service nova] Acquiring lock "refresh_cache-2ade3f5e-24a0-4989-854a-f4a90e5cf30a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-77c48b40-1904-41ab-a9b9-cc929cd1e1fc req-c734b220-abe2-4a4f-af9b-7790af38bced service nova] Acquired lock "refresh_cache-2ade3f5e-24a0-4989-854a-f4a90e5cf30a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-77c48b40-1904-41ab-a9b9-cc929cd1e1fc req-c734b220-abe2-4a4f-af9b-7790af38bced service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Refreshing network info cache for port 9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:52:14 user nova-compute[76161]: INFO nova.compute.manager [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] [instance: 11cabda6-8cc9-481f-b91c-5fd359e98515] Took 2.65 seconds to detach 3 volumes for instance.
Nov 14 17:52:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:14 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.objects.instance [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lazy-loading 'flavor' on Instance uuid 2ade3f5e-24a0-4989-854a-f4a90e5cf30a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:52:14 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Ignoring supplied device name: /dev/vdb
Nov 14 17:52:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:14 user nova-compute[76161]: INFO nova.virt.block_device [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Booting with blank volume at /dev/vda
Nov 14 17:52:15 user nova-compute[76161]: DEBUG nova.policy [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4714975d06d8455788463a30e9bc5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69696059b86f44b7ae274bf8274f9843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:15 user nova-compute[76161]: INFO nova.compute.manager [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Attaching volume b98407ca-826f-4215-9bfa-8b29c64a0ae4 to /dev/vdb
Nov 14 17:52:15 user nova-compute[76161]: DEBUG os_brick.utils [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fe4baa-c01a-46c5-8b31-e652e0d1fc72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f966814-8ff8-4cee-a420-73919069b8a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2295da8-2276-4999-9f45-2fe95b8fb011]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b193677-37f9-40da-9c89-5574f0358625]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:52:15 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:52:15 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c678ecf4-5bbb-4f25-ad7b-e80482e85c66]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG os_brick.utils [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Updating existing volume attachment record: 5bc97f6d-518a-4866-9938-0fb64fc54589 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.618s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:15 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Deleted allocations for instance 11cabda6-8cc9-481f-b91c-5fd359e98515
Nov 14 17:52:15 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Successfully created port: 420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-77c48b40-1904-41ab-a9b9-cc929cd1e1fc req-c734b220-abe2-4a4f-af9b-7790af38bced service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Updated VIF entry in instance network info cache for port 9e624cc1-9ddd-4a4d-924d-1aecdcc84c90. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-77c48b40-1904-41ab-a9b9-cc929cd1e1fc req-c734b220-abe2-4a4f-af9b-7790af38bced service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Updating instance_info_cache with network_info: [{"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-765cc15b-92a3-4bcf-b24c-80cbf762d58a tempest-TaggedBootDevicesTest-1442842885 tempest-TaggedBootDevicesTest-1442842885-project-member] Lock "11cabda6-8cc9-481f-b91c-5fd359e98515" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.784s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-77c48b40-1904-41ab-a9b9-cc929cd1e1fc req-c734b220-abe2-4a4f-af9b-7790af38bced service nova] Releasing lock "refresh_cache-2ade3f5e-24a0-4989-854a-f4a90e5cf30a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Successfully updated port: 420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquired lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG nova.compute.manager [req-22762aa2-d0b7-479e-a7f8-796197df9476 req-0a833149-43ec-494e-8678-e0080fe5e2fa service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-changed-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG nova.compute.manager [req-22762aa2-d0b7-479e-a7f8-796197df9476 req-0a833149-43ec-494e-8678-e0080fe5e2fa service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Refreshing instance network info cache due to event network-changed-420627a0-11f4-43cc-b08c-84739104b43c. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-22762aa2-d0b7-479e-a7f8-796197df9476 req-0a833149-43ec-494e-8678-e0080fe5e2fa service nova] Acquiring lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updating instance_info_cache with network_info: [{"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Releasing lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Instance network_info: |[{"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-22762aa2-d0b7-479e-a7f8-796197df9476 req-0a833149-43ec-494e-8678-e0080fe5e2fa service nova] Acquired lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:52:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-22762aa2-d0b7-479e-a7f8-796197df9476 req-0a833149-43ec-494e-8678-e0080fe5e2fa service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Refreshing network info cache for port 420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:52:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-22762aa2-d0b7-479e-a7f8-796197df9476 req-0a833149-43ec-494e-8678-e0080fe5e2fa service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updated VIF entry in instance network info cache for port 420627a0-11f4-43cc-b08c-84739104b43c. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:52:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-22762aa2-d0b7-479e-a7f8-796197df9476 req-0a833149-43ec-494e-8678-e0080fe5e2fa service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updating instance_info_cache with network_info: [{"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-22762aa2-d0b7-479e-a7f8-796197df9476 req-0a833149-43ec-494e-8678-e0080fe5e2fa service nova] Releasing lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:52:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:52:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:52:17 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:52:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:52:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:52:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating instance_info_cache with network_info: [{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpVCtHrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:20 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:20 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:20 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b71b63-278c-4194-beeb-66fff8c2adc6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:52:20 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8382115a-63e4-4b3a-a78d-cbe52ba1fa44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4] added
Nov 14 17:52:20 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b6d1c5-d244-4ce9-a59c-7cfe3185044d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0315c924-e032-4323-a6b9-c3d601781b8b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SpVCtHrY {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SpVCtHrY" returned: 0 in 0.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7248bf87-9501-4221-81e3-e9f552746e77]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SpVCtHrY'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b941b2a-fc3b-4250-9cc7-56ad9335a952]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[71050894-943b-44d3-ad0d-2f791c109e9a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:20 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:20 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[094b4d62-6e6a-444f-b97f-23e3eb08350a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4, portal: 172.16.0.220,3260]
Nov 14 17:52:20 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:20 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84c3854-c059-4e37-819d-a7279636e5b8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f522c86c-5b30-440e-b57d-e7d0e4ae8713]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:20 user nova-compute[76161]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)
Nov 14 17:52:20 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:20 user nova-compute[76161]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)
Nov 14 17:52:20 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.037s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cce08a6-07ea-41f4-910c-8aed71068a5d]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpVCtHrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.utils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e1af1e-d480-4825-a861-b1f5736f5f7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ddb94e-83ce-49d9-aa15-7ceb262b5ea5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[34331cd9-0c8a-4821-8ebd-001d53fdc9e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0227d8e4-8782-448b-8935-99e03579ffac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:52:20 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:52:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1bfec9-3e5b-48f4-8528-b1b151c1dba2]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG os_brick.utils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:20 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updating existing volume attachment record: bc13e7bd-7e2f-497d-92c5-acc1a6a8c832 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.715s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] <== connect_volume: return (1717ms) {'type': 'block', 'scsi_wwn': '26339346366303431', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339346366303431', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:52:21 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:52:21 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:52:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7517MB free_disk=25.47856903076172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:21 user nova-compute[76161]: DEBUG nova.objects.instance [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lazy-loading 'flavor' on Instance uuid 2ade3f5e-24a0-4989-854a-f4a90e5cf30a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:52:22 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:52:22 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 17:52:22 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:52:22 user nova-compute[76161]:   <serial>b98407ca-826f-4215-9bfa-8b29c64a0ae4</serial>
Nov 14 17:52:22 user nova-compute[76161]: </disk>
Nov 14 17:52:22 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56f47238-81fe-4196-865c-e1ad68cf6fea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 678e458a-aeb6-4f29-b20b-74115179025f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b45e1ad6-d346-442e-a957-9398103b143f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 32fb9960-faa6-443a-88d3-3ee3c68b27fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 2ade3f5e-24a0-4989-854a-f4a90e5cf30a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 55765bdd-d12d-4466-af2b-6912e5ae8f4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] No VIF found with MAC fa:16:3e:bc:45:3d, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-95cede38-8eb3-4aa9-9da4-7c891c9d1a60 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.729s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "8b08db54-6a49-41fa-a188-d41593d91cb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:52:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:52:25 user nova-compute[76161]: INFO nova.compute.claims [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Claim successful on node user
Nov 14 17:52:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:52:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:52:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG nova.policy [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce9768ac5fdb4774874128973d9e7b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734a545ba17409c812203610ba23ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:52:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Creating image(s)
Nov 14 17:52:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "/opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "/opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Successfully created port: a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk 1073741824" returned: 0 in 0.051s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:52:26 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Creating image(s)
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Ensure instance console log exists: /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Start _get_guest_xml network_info=[{"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptJSETF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6b27e32-d956-4f41-b278-d7d088c7edbc', 'attached_at': '', 'detached_at': '', 'volume_id': '5146bbb8-274b-49d7-864b-1333d8f9479c', 'serial': '5146bbb8-274b-49d7-864b-1333d8f9479c'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'bc13e7bd-7e2f-497d-92c5-acc1a6a8c832', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:52:26 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:52:26 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptJSETF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:26 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:26 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:26 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.221s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd1370c-4e9f-4c85-b60f-032095db8272]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:52:26 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15e9708-29e6-44b9-8bcb-d61cbf316da5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c] added
Nov 14 17:52:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.075s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1ef5b9-6c2f-4534-802b-292f0265c089]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.050s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1a0e48-86f2-48d2-a474-8ef86561d971]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Cannot resize image /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Ensure instance console log exists: /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eptJSETF {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eptJSETF" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec2ceb7-5857-4a18-a866-e4c7bc29b1a6]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eptJSETF'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6ca05d-c168-4898-9f52-4a598ea4f891]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d328232-34e4-4201-8209-519baa456530]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:26 user nova-compute[76161]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)
Nov 14 17:52:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:26 user nova-compute[76161]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)
Nov 14 17:52:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13af8d0-c145-4020-be88-5c7e88cb9725]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c, portal: 172.16.0.220,3260]
Nov 14 17:52:26 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f0149a-0418-4dc8-84d0-c3c702bcad53]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9406025a-d0dd-4487-b08e-ea0a0c1e91cf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:26 user nova-compute[76161]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)
Nov 14 17:52:26 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:52:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:26 user nova-compute[76161]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)
Nov 14 17:52:26 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:52:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:52:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[def42f5b-4781-40b3-af81-56e83c25b7f9]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptJSETF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Successfully updated port: a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "refresh_cache-8b08db54-6a49-41fa-a188-d41593d91cb9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquired lock "refresh_cache-8b08db54-6a49-41fa-a188-d41593d91cb9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-8ab4c9f2-705f-49d1-80f1-c4479364e532 req-98a7730a-f553-474a-a085-71024990f5f1 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Received event network-changed-a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-8ab4c9f2-705f-49d1-80f1-c4479364e532 req-98a7730a-f553-474a-a085-71024990f5f1 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Refreshing instance network info cache due to event network-changed-a193ca5a-05d4-414e-a041-ec300eee1a08. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8ab4c9f2-705f-49d1-80f1-c4479364e532 req-98a7730a-f553-474a-a085-71024990f5f1 service nova] Acquiring lock "refresh_cache-8b08db54-6a49-41fa-a188-d41593d91cb9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Updating instance_info_cache with network_info: [{"id": "a193ca5a-05d4-414e-a041-ec300eee1a08", "address": "fa:16:3e:e2:0b:2c", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa193ca5a-05", "ovs_interfaceid": "a193ca5a-05d4-414e-a041-ec300eee1a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Releasing lock "refresh_cache-8b08db54-6a49-41fa-a188-d41593d91cb9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Instance network_info: |[{"id": "a193ca5a-05d4-414e-a041-ec300eee1a08", "address": "fa:16:3e:e2:0b:2c", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa193ca5a-05", "ovs_interfaceid": "a193ca5a-05d4-414e-a041-ec300eee1a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8ab4c9f2-705f-49d1-80f1-c4479364e532 req-98a7730a-f553-474a-a085-71024990f5f1 service nova] Acquired lock "refresh_cache-8b08db54-6a49-41fa-a188-d41593d91cb9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-8ab4c9f2-705f-49d1-80f1-c4479364e532 req-98a7730a-f553-474a-a085-71024990f5f1 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Refreshing network info cache for port a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Start _get_guest_xml network_info=[{"id": "a193ca5a-05d4-414e-a041-ec300eee1a08", "address": "fa:16:3e:e2:0b:2c", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa193ca5a-05", "ovs_interfaceid": "a193ca5a-05d4-414e-a041-ec300eee1a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:52:27 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:52:27 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-213243073',display_name='tempest-VolumesAdminNegativeTest-server-213243073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-213243073',id=15,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c734a545ba17409c812203610ba23ab9',ramdisk_id='',reservation_id='r-tsqbvyq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-826340027',owner_user_name='tempest-VolumesAdminNegativeTest-826340027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:52:26Z,user_data=None,user_id='ce9768ac5fdb4774874128973d9e7b35',uuid=8b08db54-6a49-41fa-a188-d41593d91cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a193ca5a-05d4-414e-a041-ec300eee1a08", "address": "fa:16:3e:e2:0b:2c", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa193ca5a-05", "ovs_interfaceid": "a193ca5a-05d4-414e-a041-ec300eee1a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converting VIF {"id": "a193ca5a-05d4-414e-a041-ec300eee1a08", "address": "fa:16:3e:e2:0b:2c", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa193ca5a-05", "ovs_interfaceid": "a193ca5a-05d4-414e-a041-ec300eee1a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:2c,bridge_name='br-int',has_traffic_filtering=True,id=a193ca5a-05d4-414e-a041-ec300eee1a08,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa193ca5a-05') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.objects.instance [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b08db54-6a49-41fa-a188-d41593d91cb9 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:52:27 user nova-compute[76161]:   <uuid>8b08db54-6a49-41fa-a188-d41593d91cb9</uuid>
Nov 14 17:52:27 user nova-compute[76161]:   <name>instance-0000000f</name>
Nov 14 17:52:27 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:52:27 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:52:27 user nova-compute[76161]:   <metadata>
Nov 14 17:52:27 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:52:27 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:52:27 user nova-compute[76161]:       <nova:name>tempest-VolumesAdminNegativeTest-server-213243073</nova:name>
Nov 14 17:52:27 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:52:27</nova:creationTime>
Nov 14 17:52:27 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:52:27 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:52:27 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:52:27 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:52:27 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:52:27 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:52:27 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:52:27 user nova-compute[76161]:       <nova:owner>
Nov 14 17:52:27 user nova-compute[76161]:         <nova:user uuid="ce9768ac5fdb4774874128973d9e7b35">tempest-VolumesAdminNegativeTest-826340027-project-member</nova:user>
Nov 14 17:52:27 user nova-compute[76161]:         <nova:project uuid="c734a545ba17409c812203610ba23ab9">tempest-VolumesAdminNegativeTest-826340027</nova:project>
Nov 14 17:52:27 user nova-compute[76161]:       </nova:owner>
Nov 14 17:52:27 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:52:27 user nova-compute[76161]:       <nova:ports>
Nov 14 17:52:27 user nova-compute[76161]:         <nova:port uuid="a193ca5a-05d4-414e-a041-ec300eee1a08">
Nov 14 17:52:27 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 17:52:27 user nova-compute[76161]:         </nova:port>
Nov 14 17:52:27 user nova-compute[76161]:       </nova:ports>
Nov 14 17:52:27 user nova-compute[76161]:     </nova:instance>
Nov 14 17:52:27 user nova-compute[76161]:   </metadata>
Nov 14 17:52:27 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:52:27 user nova-compute[76161]:     <system>
Nov 14 17:52:27 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:52:27 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:52:27 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:52:27 user nova-compute[76161]:       <entry name="serial">8b08db54-6a49-41fa-a188-d41593d91cb9</entry>
Nov 14 17:52:27 user nova-compute[76161]:       <entry name="uuid">8b08db54-6a49-41fa-a188-d41593d91cb9</entry>
Nov 14 17:52:27 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:52:27 user nova-compute[76161]:     </system>
Nov 14 17:52:27 user nova-compute[76161]:   </sysinfo>
Nov 14 17:52:27 user nova-compute[76161]:   <os>
Nov 14 17:52:27 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:52:27 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:52:27 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:52:27 user nova-compute[76161]:   </os>
Nov 14 17:52:27 user nova-compute[76161]:   <features>
Nov 14 17:52:27 user nova-compute[76161]:     <acpi/>
Nov 14 17:52:27 user nova-compute[76161]:     <apic/>
Nov 14 17:52:27 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:52:27 user nova-compute[76161]:   </features>
Nov 14 17:52:27 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:52:27 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:52:27 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:52:27 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:52:27 user nova-compute[76161]:   </clock>
Nov 14 17:52:27 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:52:27 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:52:27 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:52:27 user nova-compute[76161]:   </cpu>
Nov 14 17:52:27 user nova-compute[76161]:   <devices>
Nov 14 17:52:27 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:52:27 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:52:27 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk"/>
Nov 14 17:52:27 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:52:27 user nova-compute[76161]:     </disk>
Nov 14 17:52:27 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:52:27 user nova-compute[76161]:       <mac address="fa:16:3e:e2:0b:2c"/>
Nov 14 17:52:27 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:52:27 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:52:27 user nova-compute[76161]:       <target dev="tapa193ca5a-05"/>
Nov 14 17:52:27 user nova-compute[76161]:     </interface>
Nov 14 17:52:27 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:52:27 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/console.log" append="off"/>
Nov 14 17:52:27 user nova-compute[76161]:     </serial>
Nov 14 17:52:27 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:52:27 user nova-compute[76161]:     <video>
Nov 14 17:52:27 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:52:27 user nova-compute[76161]:     </video>
Nov 14 17:52:27 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:52:27 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:52:27 user nova-compute[76161]:     </rng>
Nov 14 17:52:27 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:52:27 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:52:27 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:52:27 user nova-compute[76161]:     </memballoon>
Nov 14 17:52:27 user nova-compute[76161]:   </devices>
Nov 14 17:52:27 user nova-compute[76161]: </domain>
Nov 14 17:52:27 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-213243073',display_name='tempest-VolumesAdminNegativeTest-server-213243073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-213243073',id=15,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c734a545ba17409c812203610ba23ab9',ramdisk_id='',reservation_id='r-tsqbvyq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-826340027',owner_user_name='tempest-VolumesAdminNegativeTest-826340027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:52:26Z,user_data=None,user_id='ce9768ac5fdb4774874128973d9e7b35',uuid=8b08db54-6a49-41fa-a188-d41593d91cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a193ca5a-05d4-414e-a041-ec300eee1a08", "address": "fa:16:3e:e2:0b:2c", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa193ca5a-05", "ovs_interfaceid": "a193ca5a-05d4-414e-a041-ec300eee1a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converting VIF {"id": "a193ca5a-05d4-414e-a041-ec300eee1a08", "address": "fa:16:3e:e2:0b:2c", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa193ca5a-05", "ovs_interfaceid": "a193ca5a-05d4-414e-a041-ec300eee1a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:2c,bridge_name='br-int',has_traffic_filtering=True,id=a193ca5a-05d4-414e-a041-ec300eee1a08,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa193ca5a-05') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG os_vif [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:2c,bridge_name='br-int',has_traffic_filtering=True,id=a193ca5a-05d4-414e-a041-ec300eee1a08,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa193ca5a-05') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2df02d7b-19a7-5a72-a98f-9e1a117fe3af', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa193ca5a-05, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa193ca5a-05, col_values=(('qos', UUID('b2806cb1-40ad-42f6-89ab-c0a423976b71')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa193ca5a-05, col_values=(('external_ids', {'iface-id': 'a193ca5a-05d4-414e-a041-ec300eee1a08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:0b:2c', 'vm-uuid': '8b08db54-6a49-41fa-a188-d41593d91cb9'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:27 user nova-compute[76161]: INFO os_vif [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:2c,bridge_name='br-int',has_traffic_filtering=True,id=a193ca5a-05d4-414e-a041-ec300eee1a08,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa193ca5a-05')
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:52:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] No VIF found with MAC fa:16:3e:e2:0b:2c, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.505s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '23736336232643963', 'path': '/dev/sdd'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736336232643963', 'path': '/dev/sdd'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1186448522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1186448522',id=14,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-c0ltbv0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:52:15Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=e6b27e32-d956-4f41-b278-d7d088c7edbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=420627a0-11f4-43cc-b08c-84739104b43c,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420627a0-11') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'pci_devices' on Instance uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:52:28 user nova-compute[76161]:   <uuid>e6b27e32-d956-4f41-b278-d7d088c7edbc</uuid>
Nov 14 17:52:28 user nova-compute[76161]:   <name>instance-0000000e</name>
Nov 14 17:52:28 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:52:28 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:52:28 user nova-compute[76161]:   <metadata>
Nov 14 17:52:28 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:52:28 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:52:28 user nova-compute[76161]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1186448522</nova:name>
Nov 14 17:52:28 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:52:26</nova:creationTime>
Nov 14 17:52:28 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:52:28 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:52:28 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:52:28 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:52:28 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:52:28 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:52:28 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:52:28 user nova-compute[76161]:       <nova:owner>
Nov 14 17:52:28 user nova-compute[76161]:         <nova:user uuid="4714975d06d8455788463a30e9bc5faa">tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member</nova:user>
Nov 14 17:52:28 user nova-compute[76161]:         <nova:project uuid="69696059b86f44b7ae274bf8274f9843">tempest-ServerBootFromVolumeStableRescueTest-500586355</nova:project>
Nov 14 17:52:28 user nova-compute[76161]:       </nova:owner>
Nov 14 17:52:28 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:52:28 user nova-compute[76161]:       <nova:ports>
Nov 14 17:52:28 user nova-compute[76161]:         <nova:port uuid="420627a0-11f4-43cc-b08c-84739104b43c">
Nov 14 17:52:28 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 17:52:28 user nova-compute[76161]:         </nova:port>
Nov 14 17:52:28 user nova-compute[76161]:       </nova:ports>
Nov 14 17:52:28 user nova-compute[76161]:     </nova:instance>
Nov 14 17:52:28 user nova-compute[76161]:   </metadata>
Nov 14 17:52:28 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:52:28 user nova-compute[76161]:     <system>
Nov 14 17:52:28 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:52:28 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:52:28 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:52:28 user nova-compute[76161]:       <entry name="serial">e6b27e32-d956-4f41-b278-d7d088c7edbc</entry>
Nov 14 17:52:28 user nova-compute[76161]:       <entry name="uuid">e6b27e32-d956-4f41-b278-d7d088c7edbc</entry>
Nov 14 17:52:28 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:52:28 user nova-compute[76161]:     </system>
Nov 14 17:52:28 user nova-compute[76161]:   </sysinfo>
Nov 14 17:52:28 user nova-compute[76161]:   <os>
Nov 14 17:52:28 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:52:28 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:52:28 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:52:28 user nova-compute[76161]:   </os>
Nov 14 17:52:28 user nova-compute[76161]:   <features>
Nov 14 17:52:28 user nova-compute[76161]:     <acpi/>
Nov 14 17:52:28 user nova-compute[76161]:     <apic/>
Nov 14 17:52:28 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:52:28 user nova-compute[76161]:   </features>
Nov 14 17:52:28 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:52:28 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:52:28 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:52:28 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:52:28 user nova-compute[76161]:   </clock>
Nov 14 17:52:28 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:52:28 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:52:28 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:52:28 user nova-compute[76161]:   </cpu>
Nov 14 17:52:28 user nova-compute[76161]:   <devices>
Nov 14 17:52:28 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:52:28 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:52:28 user nova-compute[76161]:       <source dev="/dev/sdd"/>
Nov 14 17:52:28 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:52:28 user nova-compute[76161]:       <serial>5146bbb8-274b-49d7-864b-1333d8f9479c</serial>
Nov 14 17:52:28 user nova-compute[76161]:     </disk>
Nov 14 17:52:28 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:52:28 user nova-compute[76161]:       <mac address="fa:16:3e:96:f2:43"/>
Nov 14 17:52:28 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:52:28 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:52:28 user nova-compute[76161]:       <target dev="tap420627a0-11"/>
Nov 14 17:52:28 user nova-compute[76161]:     </interface>
Nov 14 17:52:28 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:52:28 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/console.log" append="off"/>
Nov 14 17:52:28 user nova-compute[76161]:     </serial>
Nov 14 17:52:28 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:52:28 user nova-compute[76161]:     <video>
Nov 14 17:52:28 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:52:28 user nova-compute[76161]:     </video>
Nov 14 17:52:28 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:52:28 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:52:28 user nova-compute[76161]:     </rng>
Nov 14 17:52:28 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:52:28 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:52:28 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:52:28 user nova-compute[76161]:     </memballoon>
Nov 14 17:52:28 user nova-compute[76161]:   </devices>
Nov 14 17:52:28 user nova-compute[76161]: </domain>
Nov 14 17:52:28 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1186448522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1186448522',id=14,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-c0ltbv0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:52:15Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=e6b27e32-d956-4f41-b278-d7d088c7edbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=420627a0-11f4-43cc-b08c-84739104b43c,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420627a0-11') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG os_vif [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=420627a0-11f4-43cc-b08c-84739104b43c,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420627a0-11') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.network.neutron [req-8ab4c9f2-705f-49d1-80f1-c4479364e532 req-98a7730a-f553-474a-a085-71024990f5f1 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Updated VIF entry in instance network info cache for port a193ca5a-05d4-414e-a041-ec300eee1a08. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.network.neutron [req-8ab4c9f2-705f-49d1-80f1-c4479364e532 req-98a7730a-f553-474a-a085-71024990f5f1 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Updating instance_info_cache with network_info: [{"id": "a193ca5a-05d4-414e-a041-ec300eee1a08", "address": "fa:16:3e:e2:0b:2c", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa193ca5a-05", "ovs_interfaceid": "a193ca5a-05d4-414e-a041-ec300eee1a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '116d18ef-c622-5aaa-946d-c2decf6b3944', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8ab4c9f2-705f-49d1-80f1-c4479364e532 req-98a7730a-f553-474a-a085-71024990f5f1 service nova] Releasing lock "refresh_cache-8b08db54-6a49-41fa-a188-d41593d91cb9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap420627a0-11, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap420627a0-11, col_values=(('qos', UUID('0c85f238-0914-4ed5-bc78-26a22f4d09f7')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap420627a0-11, col_values=(('external_ids', {'iface-id': '420627a0-11f4-43cc-b08c-84739104b43c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:f2:43', 'vm-uuid': 'e6b27e32-d956-4f41-b278-d7d088c7edbc'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:28 user nova-compute[76161]: INFO os_vif [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=420627a0-11f4-43cc-b08c-84739104b43c,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420627a0-11')
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:52:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No VIF found with MAC fa:16:3e:96:f2:43, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:52:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-c01597e0-15f7-43eb-888c-e80975b30c89 req-6d5dd97c-f489-43f2-a0f2-f1bc13d50feb service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Received event network-vif-plugged-a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c01597e0-15f7-43eb-888c-e80975b30c89 req-6d5dd97c-f489-43f2-a0f2-f1bc13d50feb service nova] Acquiring lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c01597e0-15f7-43eb-888c-e80975b30c89 req-6d5dd97c-f489-43f2-a0f2-f1bc13d50feb service nova] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c01597e0-15f7-43eb-888c-e80975b30c89 req-6d5dd97c-f489-43f2-a0f2-f1bc13d50feb service nova] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-c01597e0-15f7-43eb-888c-e80975b30c89 req-6d5dd97c-f489-43f2-a0f2-f1bc13d50feb service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] No waiting events found dispatching network-vif-plugged-a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:30 user nova-compute[76161]: WARNING nova.compute.manager [req-c01597e0-15f7-43eb-888c-e80975b30c89 req-6d5dd97c-f489-43f2-a0f2-f1bc13d50feb service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Received unexpected event network-vif-plugged-a193ca5a-05d4-414e-a041-ec300eee1a08 for instance with vm_state building and task_state spawning.
Nov 14 17:52:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-0481ea86-f95c-42af-b234-77979b688e0c req-07e25ece-9c54-4e5b-ae67-5dd308274a4f service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Received event network-vif-plugged-a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0481ea86-f95c-42af-b234-77979b688e0c req-07e25ece-9c54-4e5b-ae67-5dd308274a4f service nova] Acquiring lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0481ea86-f95c-42af-b234-77979b688e0c req-07e25ece-9c54-4e5b-ae67-5dd308274a4f service nova] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0481ea86-f95c-42af-b234-77979b688e0c req-07e25ece-9c54-4e5b-ae67-5dd308274a4f service nova] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-0481ea86-f95c-42af-b234-77979b688e0c req-07e25ece-9c54-4e5b-ae67-5dd308274a4f service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] No waiting events found dispatching network-vif-plugged-a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:32 user nova-compute[76161]: WARNING nova.compute.manager [req-0481ea86-f95c-42af-b234-77979b688e0c req-07e25ece-9c54-4e5b-ae67-5dd308274a4f service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Received unexpected event network-vif-plugged-a193ca5a-05d4-414e-a041-ec300eee1a08 for instance with vm_state building and task_state spawning.
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:52:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Instance spawned successfully.
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-9ec26aa3-a731-4bf6-8891-587c583d06ef req-75fe3634-33d1-49d0-910d-025386d214f4 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9ec26aa3-a731-4bf6-8891-587c583d06ef req-75fe3634-33d1-49d0-910d-025386d214f4 service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9ec26aa3-a731-4bf6-8891-587c583d06ef req-75fe3634-33d1-49d0-910d-025386d214f4 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9ec26aa3-a731-4bf6-8891-587c583d06ef req-75fe3634-33d1-49d0-910d-025386d214f4 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-9ec26aa3-a731-4bf6-8891-587c583d06ef req-75fe3634-33d1-49d0-910d-025386d214f4 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:32 user nova-compute[76161]: WARNING nova.compute.manager [req-9ec26aa3-a731-4bf6-8891-587c583d06ef req-75fe3634-33d1-49d0-910d-025386d214f4 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state building and task_state spawning.
Nov 14 17:52:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Instance spawned successfully.
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:32 user nova-compute[76161]: INFO nova.compute.manager [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Took 7.13 seconds to spawn the instance on the hypervisor.
Nov 14 17:52:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:52:33 user nova-compute[76161]: INFO nova.compute.manager [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Took 6.59 seconds to spawn the instance on the hypervisor.
Nov 14 17:52:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:52:33 user nova-compute[76161]: INFO nova.compute.manager [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Took 8.12 seconds to build instance.
Nov 14 17:52:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dba51fae-6a67-48e3-809b-58194824cd5e tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.244s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:33 user nova-compute[76161]: INFO nova.compute.manager [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Took 19.11 seconds to build instance.
Nov 14 17:52:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6236bb73-fe3e-4d40-a80c-35ad163d5fd7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.206s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:52:33 user nova-compute[76161]: INFO nova.compute.claims [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Claim successful on node user
Nov 14 17:52:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:33 user nova-compute[76161]: INFO nova.compute.manager [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Detaching volume b98407ca-826f-4215-9bfa-8b29c64a0ae4
Nov 14 17:52:33 user nova-compute[76161]: INFO nova.virt.block_device [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Attempting to driver detach volume b98407ca-826f-4215-9bfa-8b29c64a0ae4 from mountpoint /dev/vdb
Nov 14 17:52:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Attempting to detach device vdb from instance 2ade3f5e-24a0-4989-854a-f4a90e5cf30a from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:52:33 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:52:33 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 17:52:33 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:52:33 user nova-compute[76161]:   <serial>b98407ca-826f-4215-9bfa-8b29c64a0ae4</serial>
Nov 14 17:52:33 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:52:33 user nova-compute[76161]: </disk>
Nov 14 17:52:33 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:52:33 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Successfully detached device vdb from instance 2ade3f5e-24a0-4989-854a-f4a90e5cf30a from the persistent domain config.
Nov 14 17:52:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ade3f5e-24a0-4989-854a-f4a90e5cf30a from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:52:33 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:52:33 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 17:52:33 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:52:33 user nova-compute[76161]:   <serial>b98407ca-826f-4215-9bfa-8b29c64a0ae4</serial>
Nov 14 17:52:33 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:52:33 user nova-compute[76161]: </disk>
Nov 14 17:52:33 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.network.neutron [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:52:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.policy [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f77ddf30c3a4891991fd2bb6e95b297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b442ba233de4096a5e0fa2e04d0853f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:52:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Creating image(s)
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ade3f5e-24a0-4989-854a-f4a90e5cf30a {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk 1073741824" returned: 0 in 0.089s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.network.neutron [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Successfully created port: efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.196s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-ddcb9ce1-e86d-4a09-afad-6e790640845f req-b32229fa-e697-4ab2-b9b4-b94841dde042 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ddcb9ce1-e86d-4a09-afad-6e790640845f req-b32229fa-e697-4ab2-b9b4-b94841dde042 service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ddcb9ce1-e86d-4a09-afad-6e790640845f req-b32229fa-e697-4ab2-b9b4-b94841dde042 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ddcb9ce1-e86d-4a09-afad-6e790640845f req-b32229fa-e697-4ab2-b9b4-b94841dde042 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-ddcb9ce1-e86d-4a09-afad-6e790640845f req-b32229fa-e697-4ab2-b9b4-b94841dde042 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:34 user nova-compute[76161]: WARNING nova.compute.manager [req-ddcb9ce1-e86d-4a09-afad-6e790640845f req-b32229fa-e697-4ab2-b9b4-b94841dde042 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state active and task_state None.
Nov 14 17:52:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Cannot resize image /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Ensure instance console log exists: /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.network.neutron [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Successfully updated port: efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquired lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.network.neutron [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-e32ac83a-8262-4ce4-8d6e-e5c17435dec4 req-9290dd3b-bbbc-47be-b440-4c71cc9877d5 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-changed-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-e32ac83a-8262-4ce4-8d6e-e5c17435dec4 req-9290dd3b-bbbc-47be-b440-4c71cc9877d5 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Refreshing instance network info cache due to event network-changed-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e32ac83a-8262-4ce4-8d6e-e5c17435dec4 req-9290dd3b-bbbc-47be-b440-4c71cc9877d5 service nova] Acquiring lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.network.neutron [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.network.neutron [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updating instance_info_cache with network_info: [{"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Releasing lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.compute.manager [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Instance network_info: |[{"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e32ac83a-8262-4ce4-8d6e-e5c17435dec4 req-9290dd3b-bbbc-47be-b440-4c71cc9877d5 service nova] Acquired lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.network.neutron [req-e32ac83a-8262-4ce4-8d6e-e5c17435dec4 req-9290dd3b-bbbc-47be-b440-4c71cc9877d5 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Refreshing network info cache for port efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Start _get_guest_xml network_info=[{"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:52:35 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:52:35 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235698834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235698834',id=16,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL15D+kMQspaKeW7+Bx5Dn7IFwRs/JMwFGq2/FmaQr23P9jWrQHvM1225hzBmTZF7rA/Hf1M98y9sJNaTlvjxHJCuE4gTpn+otFGMWDM/pMcafW1YhRqWDPdGRMGZKc0pw==',key_name='tempest-keypair-813492960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b442ba233de4096a5e0fa2e04d0853f',ramdisk_id='',reservation_id='r-qyf2fo90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-894639612',owner_user_name='tempest-TaggedAttachmentsTest-894639612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f77ddf30c3a4891991fd2bb6e95b297',uuid=b37a7f95-b429-431a-b837-a650fd1ee27e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converting VIF {"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=efc2c7fd-10f7-4ecc-a87d-c2f0c010d992,network=Network(b80a4ef5-f8e5-4dda-a07a-1f90e3e673be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc2c7fd-10') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.objects.instance [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lazy-loading 'pci_devices' on Instance uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:52:35 user nova-compute[76161]:   <uuid>b37a7f95-b429-431a-b837-a650fd1ee27e</uuid>
Nov 14 17:52:35 user nova-compute[76161]:   <name>instance-00000010</name>
Nov 14 17:52:35 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:52:35 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:52:35 user nova-compute[76161]:   <metadata>
Nov 14 17:52:35 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:52:35 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:52:35 user nova-compute[76161]:       <nova:name>tempest-device-tagging-server-235698834</nova:name>
Nov 14 17:52:35 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:52:35</nova:creationTime>
Nov 14 17:52:35 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:52:35 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:52:35 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:52:35 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:52:35 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:52:35 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:52:35 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:52:35 user nova-compute[76161]:       <nova:owner>
Nov 14 17:52:35 user nova-compute[76161]:         <nova:user uuid="1f77ddf30c3a4891991fd2bb6e95b297">tempest-TaggedAttachmentsTest-894639612-project-member</nova:user>
Nov 14 17:52:35 user nova-compute[76161]:         <nova:project uuid="3b442ba233de4096a5e0fa2e04d0853f">tempest-TaggedAttachmentsTest-894639612</nova:project>
Nov 14 17:52:35 user nova-compute[76161]:       </nova:owner>
Nov 14 17:52:35 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:52:35 user nova-compute[76161]:       <nova:ports>
Nov 14 17:52:35 user nova-compute[76161]:         <nova:port uuid="efc2c7fd-10f7-4ecc-a87d-c2f0c010d992">
Nov 14 17:52:35 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:52:35 user nova-compute[76161]:         </nova:port>
Nov 14 17:52:35 user nova-compute[76161]:       </nova:ports>
Nov 14 17:52:35 user nova-compute[76161]:     </nova:instance>
Nov 14 17:52:35 user nova-compute[76161]:   </metadata>
Nov 14 17:52:35 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:52:35 user nova-compute[76161]:     <system>
Nov 14 17:52:35 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:52:35 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:52:35 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:52:35 user nova-compute[76161]:       <entry name="serial">b37a7f95-b429-431a-b837-a650fd1ee27e</entry>
Nov 14 17:52:35 user nova-compute[76161]:       <entry name="uuid">b37a7f95-b429-431a-b837-a650fd1ee27e</entry>
Nov 14 17:52:35 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:52:35 user nova-compute[76161]:     </system>
Nov 14 17:52:35 user nova-compute[76161]:   </sysinfo>
Nov 14 17:52:35 user nova-compute[76161]:   <os>
Nov 14 17:52:35 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:52:35 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:52:35 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:52:35 user nova-compute[76161]:   </os>
Nov 14 17:52:35 user nova-compute[76161]:   <features>
Nov 14 17:52:35 user nova-compute[76161]:     <acpi/>
Nov 14 17:52:35 user nova-compute[76161]:     <apic/>
Nov 14 17:52:35 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:52:35 user nova-compute[76161]:   </features>
Nov 14 17:52:35 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:52:35 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:52:35 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:52:35 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:52:35 user nova-compute[76161]:   </clock>
Nov 14 17:52:35 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:52:35 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:52:35 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:52:35 user nova-compute[76161]:   </cpu>
Nov 14 17:52:35 user nova-compute[76161]:   <devices>
Nov 14 17:52:35 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:52:35 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:52:35 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk"/>
Nov 14 17:52:35 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:52:35 user nova-compute[76161]:     </disk>
Nov 14 17:52:35 user nova-compute[76161]:     <disk type="file" device="cdrom">
Nov 14 17:52:35 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 17:52:35 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.config"/>
Nov 14 17:52:35 user nova-compute[76161]:       <target dev="hda" bus="ide"/>
Nov 14 17:52:35 user nova-compute[76161]:     </disk>
Nov 14 17:52:35 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:52:35 user nova-compute[76161]:       <mac address="fa:16:3e:9d:da:2c"/>
Nov 14 17:52:35 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:52:35 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:52:35 user nova-compute[76161]:       <target dev="tapefc2c7fd-10"/>
Nov 14 17:52:35 user nova-compute[76161]:     </interface>
Nov 14 17:52:35 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:52:35 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/console.log" append="off"/>
Nov 14 17:52:35 user nova-compute[76161]:     </serial>
Nov 14 17:52:35 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:52:35 user nova-compute[76161]:     <video>
Nov 14 17:52:35 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:52:35 user nova-compute[76161]:     </video>
Nov 14 17:52:35 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:52:35 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:52:35 user nova-compute[76161]:     </rng>
Nov 14 17:52:35 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:52:35 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:52:35 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:52:35 user nova-compute[76161]:     </memballoon>
Nov 14 17:52:35 user nova-compute[76161]:   </devices>
Nov 14 17:52:35 user nova-compute[76161]: </domain>
Nov 14 17:52:35 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235698834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235698834',id=16,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL15D+kMQspaKeW7+Bx5Dn7IFwRs/JMwFGq2/FmaQr23P9jWrQHvM1225hzBmTZF7rA/Hf1M98y9sJNaTlvjxHJCuE4gTpn+otFGMWDM/pMcafW1YhRqWDPdGRMGZKc0pw==',key_name='tempest-keypair-813492960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b442ba233de4096a5e0fa2e04d0853f',ramdisk_id='',reservation_id='r-qyf2fo90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-894639612',owner_user_name='tempest-TaggedAttachmentsTest-894639612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f77ddf30c3a4891991fd2bb6e95b297',uuid=b37a7f95-b429-431a-b837-a650fd1ee27e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converting VIF {"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=efc2c7fd-10f7-4ecc-a87d-c2f0c010d992,network=Network(b80a4ef5-f8e5-4dda-a07a-1f90e3e673be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc2c7fd-10') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG os_vif [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=efc2c7fd-10f7-4ecc-a87d-c2f0c010d992,network=Network(b80a4ef5-f8e5-4dda-a07a-1f90e3e673be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc2c7fd-10') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27ffb35c-7c88-595f-acdb-94c0ecd4e807', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefc2c7fd-10, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefc2c7fd-10, col_values=(('qos', UUID('eba9b367-9a68-4435-a5f2-195c3050557e')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefc2c7fd-10, col_values=(('external_ids', {'iface-id': 'efc2c7fd-10f7-4ecc-a87d-c2f0c010d992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:da:2c', 'vm-uuid': 'b37a7f95-b429-431a-b837-a650fd1ee27e'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:35 user nova-compute[76161]: INFO os_vif [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=efc2c7fd-10f7-4ecc-a87d-c2f0c010d992,network=Network(b80a4ef5-f8e5-4dda-a07a-1f90e3e673be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc2c7fd-10')
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] No BDM found with device name hda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:52:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] No VIF found with MAC fa:16:3e:9d:da:2c, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:52:35 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Using config drive
Nov 14 17:52:36 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Creating config drive at /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.config
Nov 14 17:52:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiozpl239 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG nova.network.neutron [req-e32ac83a-8262-4ce4-8d6e-e5c17435dec4 req-9290dd3b-bbbc-47be-b440-4c71cc9877d5 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updated VIF entry in instance network info cache for port efc2c7fd-10f7-4ecc-a87d-c2f0c010d992. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG nova.network.neutron [req-e32ac83a-8262-4ce4-8d6e-e5c17435dec4 req-9290dd3b-bbbc-47be-b440-4c71cc9877d5 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updating instance_info_cache with network_info: [{"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiozpl239" returned: 0 in 0.075s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e32ac83a-8262-4ce4-8d6e-e5c17435dec4 req-9290dd3b-bbbc-47be-b440-4c71cc9877d5 service nova] Releasing lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "b45e1ad6-d346-442e-a957-9398103b143f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:36 user nova-compute[76161]: INFO nova.compute.manager [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Terminating instance
Nov 14 17:52:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-vif-unplugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] No waiting events found dispatching network-vif-unplugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-vif-unplugged-560312f9-47a0-4257-a55a-e06dfcc78799 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] No waiting events found dispatching network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:37 user nova-compute[76161]: WARNING nova.compute.manager [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received unexpected event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 for instance with vm_state active and task_state deleting.
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] No waiting events found dispatching network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:37 user nova-compute[76161]: WARNING nova.compute.manager [req-430f33dd-1d45-4f73-907c-c3882fd0cd3c req-9fe97cbb-0e0d-41f1-be0a-caa411a3853a service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received unexpected event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 for instance with vm_state active and task_state deleting.
Nov 14 17:52:37 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Instance destroyed successfully.
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lazy-loading 'resources' on Instance uuid b45e1ad6-d346-442e-a957-9398103b143f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1205124622',display_name='tempest-VolumesAssistedSnapshotsTest-server-1205124622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1205124622',id=8,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOe2t9rOSF854cKdmTggrueHZoFyTiFe7wHCsaHQFQh2Le4XtZZdgAilXbjhp5GJFcCKg1sxNpey5qIWUCufaQN2yedopwZ8z/XcOlNqmGKlWL40halWGIm0SaAaR6D7Q==',key_name='tempest-keypair-1597114662',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:49:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6199e7198cc24a739d84f79e067f4f19',ramdisk_id='',reservation_id='r-kefuy3vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1559245320',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1559245320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5af26423a8574df18c5a1292d769c3e1',uuid=b45e1ad6-d346-442e-a957-9398103b143f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Converting VIF {"id": "560312f9-47a0-4257-a55a-e06dfcc78799", "address": "fa:16:3e:5c:15:f4", "network": {"id": "c7725184-fac4-496b-bd9f-4a407bf3ab33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-425693353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6199e7198cc24a739d84f79e067f4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap560312f9-47", "ovs_interfaceid": "560312f9-47a0-4257-a55a-e06dfcc78799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:15:f4,bridge_name='br-int',has_traffic_filtering=True,id=560312f9-47a0-4257-a55a-e06dfcc78799,network=Network(c7725184-fac4-496b-bd9f-4a407bf3ab33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap560312f9-47') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG os_vif [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:15:f4,bridge_name='br-int',has_traffic_filtering=True,id=560312f9-47a0-4257-a55a-e06dfcc78799,network=Network(c7725184-fac4-496b-bd9f-4a407bf3ab33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap560312f9-47') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap560312f9-47, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34f7b18a-3808-482d-9cc2-7af56be55dc2) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: INFO os_vif [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:15:f4,bridge_name='br-int',has_traffic_filtering=True,id=560312f9-47a0-4257-a55a-e06dfcc78799,network=Network(c7725184-fac4-496b-bd9f-4a407bf3ab33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap560312f9-47')
Nov 14 17:52:37 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Deleting instance files /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f_del
Nov 14 17:52:37 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Deletion of /opt/stack/data/nova/instances/b45e1ad6-d346-442e-a957-9398103b143f_del complete
Nov 14 17:52:37 user nova-compute[76161]: INFO nova.compute.manager [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 14 17:52:37 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: b45e1ad6-d346-442e-a957-9398103b143f] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-91f9b0d0-a960-4b40-9a07-109cbe7c6b74 req-5a2a85cb-da3f-4229-a037-76837ecb88e0 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-91f9b0d0-a960-4b40-9a07-109cbe7c6b74 req-5a2a85cb-da3f-4229-a037-76837ecb88e0 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-91f9b0d0-a960-4b40-9a07-109cbe7c6b74 req-5a2a85cb-da3f-4229-a037-76837ecb88e0 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-91f9b0d0-a960-4b40-9a07-109cbe7c6b74 req-5a2a85cb-da3f-4229-a037-76837ecb88e0 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-91f9b0d0-a960-4b40-9a07-109cbe7c6b74 req-5a2a85cb-da3f-4229-a037-76837ecb88e0 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:38 user nova-compute[76161]: WARNING nova.compute.manager [req-91f9b0d0-a960-4b40-9a07-109cbe7c6b74 req-5a2a85cb-da3f-4229-a037-76837ecb88e0 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 for instance with vm_state building and task_state spawning.
Nov 14 17:52:38 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:38 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Took 1.18 seconds to deallocate network for instance.
Nov 14 17:52:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:39 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Deleted allocations for instance b45e1ad6-d346-442e-a957-9398103b143f
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7cc2f04-3493-4d9f-a319-1912e619d904 tempest-VolumesAssistedSnapshotsTest-1559245320 tempest-VolumesAssistedSnapshotsTest-1559245320-project-member] Lock "b45e1ad6-d346-442e-a957-9398103b143f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.234s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] No waiting events found dispatching network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:39 user nova-compute[76161]: WARNING nova.compute.manager [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received unexpected event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 for instance with vm_state deleted and task_state None.
Nov 14 17:52:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-vif-unplugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] No waiting events found dispatching network-vif-unplugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:39 user nova-compute[76161]: WARNING nova.compute.manager [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received unexpected event network-vif-unplugged-560312f9-47a0-4257-a55a-e06dfcc78799 for instance with vm_state deleted and task_state None.
Nov 14 17:52:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] Acquiring lock "b45e1ad6-d346-442e-a957-9398103b143f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] Lock "b45e1ad6-d346-442e-a957-9398103b143f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] No waiting events found dispatching network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:39 user nova-compute[76161]: WARNING nova.compute.manager [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received unexpected event network-vif-plugged-560312f9-47a0-4257-a55a-e06dfcc78799 for instance with vm_state deleted and task_state None.
Nov 14 17:52:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-13ce0074-14c9-420b-b43c-363b48c8e1f5 req-a7b11a22-464c-4b33-9269-d971dce49579 service nova] [instance: b45e1ad6-d346-442e-a957-9398103b143f] Received event network-vif-deleted-560312f9-47a0-4257-a55a-e06dfcc78799 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-cf479e5d-80bc-4e2c-9cd9-1472b15fe53e req-04856ab7-8952-40c4-9d6c-f72ee9f971c6 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cf479e5d-80bc-4e2c-9cd9-1472b15fe53e req-04856ab7-8952-40c4-9d6c-f72ee9f971c6 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cf479e5d-80bc-4e2c-9cd9-1472b15fe53e req-04856ab7-8952-40c4-9d6c-f72ee9f971c6 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cf479e5d-80bc-4e2c-9cd9-1472b15fe53e req-04856ab7-8952-40c4-9d6c-f72ee9f971c6 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-cf479e5d-80bc-4e2c-9cd9-1472b15fe53e req-04856ab7-8952-40c4-9d6c-f72ee9f971c6 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:40 user nova-compute[76161]: WARNING nova.compute.manager [req-cf479e5d-80bc-4e2c-9cd9-1472b15fe53e req-04856ab7-8952-40c4-9d6c-f72ee9f971c6 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 for instance with vm_state building and task_state spawning.
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:52:40 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Instance spawned successfully.
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:52:40 user nova-compute[76161]: INFO nova.compute.manager [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 14 17:52:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:52:40 user nova-compute[76161]: INFO nova.compute.manager [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Took 7.38 seconds to build instance.
Nov 14 17:52:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-198b0bd7-1b9f-4274-a067-37fb07fcc306 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.484s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:54 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2ade3f5e-24a0-4989-854a-f4a90e5cf30a is timed out.
Nov 14 17:52:54 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Successfully detached device vdb from instance 2ade3f5e-24a0-4989-854a-f4a90e5cf30a from the live domain config.
Nov 14 17:52:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpVCtHrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:54 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[92104f68-cddd-44b1-8422-57d8be3740e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:52:54 user nova-compute[76161]: No targets found.
Nov 14 17:52:54 user nova-compute[76161]: iSNS:
Nov 14 17:52:54 user nova-compute[76161]: No targets found.
Nov 14 17:52:54 user nova-compute[76161]: STATIC:
Nov 14 17:52:54 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4
Nov 14 17:52:54 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:54 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:54 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc
Nov 14 17:52:54 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:54 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:54 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:52:54 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:54 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:54 user nova-compute[76161]: FIRMWARE:
Nov 14 17:52:54 user nova-compute[76161]: No targets found.
Nov 14 17:52:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:52:54 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:52:54 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55d5334-1b00-4b81-ab68-b3db2bc7ef10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[21951e86-1f83-4899-9fad-ee1e65915e6f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:54 user nova-compute[76161]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)
Nov 14 17:52:54 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:52:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:54 user nova-compute[76161]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 (non-flash)
Nov 14 17:52:54 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:52:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f03b16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[384ad13a-11ff-4367-a485-2b1b98022178]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5519e9f4-8ae7-4e4b-99ff-581d02573b8a]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6cfbfa-2ff3-41ff-b469-97a26e7f1494]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd796637-bbfc-4da7-98f2-ef237b48abdb]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f9b480-ded1-4a4d-935e-4232a113078d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb9454-5df8-4b92-8e78-ea9342e8dbda]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4, portal: 172.16.0.220,3260]
Nov 14 17:52:54 user nova-compute[76161]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4, portal: 172.16.0.220,3260] successful.
Nov 14 17:52:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[870ec15e-eb43-4924-8f13-2012016fc3c2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] <== disconnect_volume: return (360ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:52:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG nova.objects.instance [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lazy-loading 'flavor' on Instance uuid 2ade3f5e-24a0-4989-854a-f4a90e5cf30a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1d8d6b53-4b96-47a1-9fc4-14cb4af61424 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.963s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.756s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:55 user nova-compute[76161]: INFO nova.compute.manager [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Terminating instance
Nov 14 17:52:55 user nova-compute[76161]: DEBUG nova.compute.manager [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-96d548ca-aef8-474e-ab33-82a5849c40a8 req-fc95a363-226a-4ab7-80af-6485ac9e0f08 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received event network-vif-unplugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-96d548ca-aef8-474e-ab33-82a5849c40a8 req-fc95a363-226a-4ab7-80af-6485ac9e0f08 service nova] Acquiring lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-96d548ca-aef8-474e-ab33-82a5849c40a8 req-fc95a363-226a-4ab7-80af-6485ac9e0f08 service nova] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-96d548ca-aef8-474e-ab33-82a5849c40a8 req-fc95a363-226a-4ab7-80af-6485ac9e0f08 service nova] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-96d548ca-aef8-474e-ab33-82a5849c40a8 req-fc95a363-226a-4ab7-80af-6485ac9e0f08 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] No waiting events found dispatching network-vif-unplugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-96d548ca-aef8-474e-ab33-82a5849c40a8 req-fc95a363-226a-4ab7-80af-6485ac9e0f08 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received event network-vif-unplugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Instance destroyed successfully.
Nov 14 17:52:56 user nova-compute[76161]: DEBUG nova.objects.instance [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lazy-loading 'resources' on Instance uuid 2ade3f5e-24a0-4989-854a-f4a90e5cf30a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1060209255',display_name='tempest-VolumesSnapshotTestJSON-instance-1060209255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1060209255',id=12,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIa9deK2vCKuisnbPqZ1BnyqGrG3V2AjClocao4NNpRJ9L0536oPP/E+r2m64tptl5uHSbwUYjo16AStNDNXZPVv65RDeRKyfgEbjfT06Mr4DR576OWHFszqSS7LLxU3A==',key_name='tempest-keypair-1362659200',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec9d6960a8574bf5879639b40b156a86',ramdisk_id='',reservation_id='r-iimck8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-688447987',owner_user_name='tempest-VolumesSnapshotTestJSON-688447987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:50:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='470be45a97bd464b9d22b2fb6f97cf95',uuid=2ade3f5e-24a0-4989-854a-f4a90e5cf30a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converting VIF {"id": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "address": "fa:16:3e:bc:45:3d", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e624cc1-9d", "ovs_interfaceid": "9e624cc1-9ddd-4a4d-924d-1aecdcc84c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=9e624cc1-9ddd-4a4d-924d-1aecdcc84c90,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e624cc1-9d') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_vif [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=9e624cc1-9ddd-4a4d-924d-1aecdcc84c90,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e624cc1-9d') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e624cc1-9d, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b587f98b-f30d-4aee-9b82-9fdba520a9d0) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:56 user nova-compute[76161]: INFO os_vif [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:45:3d,bridge_name='br-int',has_traffic_filtering=True,id=9e624cc1-9ddd-4a4d-924d-1aecdcc84c90,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e624cc1-9d')
Nov 14 17:52:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpVCtHrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:52:56 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[191bae85-7beb-467e-97be-0420b6056eb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:52:56 user nova-compute[76161]: No targets found.
Nov 14 17:52:56 user nova-compute[76161]: iSNS:
Nov 14 17:52:56 user nova-compute[76161]: No targets found.
Nov 14 17:52:56 user nova-compute[76161]: STATIC:
Nov 14 17:52:56 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc
Nov 14 17:52:56 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:56 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:56 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:52:56 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:52:56 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:52:56 user nova-compute[76161]: FIRMWARE:
Nov 14 17:52:56 user nova-compute[76161]: No targets found.
Nov 14 17:52:56 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:52:56 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:52:56 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98407ca-826f-4215-9bfa-8b29c64a0ae4', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d75c450-45ce-4d83-9a13-24f28f5834be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c51ee2-735d-4112-8a82-41b852e1539a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:56 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:52:56 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:52:56 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:52:56 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0282170>, {}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Disconnecting from: [] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] <== disconnect_volume: return (67ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:52:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Deleting instance files /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a_del
Nov 14 17:52:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Deletion of /opt/stack/data/nova/instances/2ade3f5e-24a0-4989-854a-f4a90e5cf30a_del complete
Nov 14 17:52:56 user nova-compute[76161]: INFO nova.compute.manager [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:56 user nova-compute[76161]: INFO nova.compute.manager [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Terminating instance
Nov 14 17:52:56 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Instance destroyed successfully.
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lazy-loading 'resources' on Instance uuid 55765bdd-d12d-4466-af2b-6912e5ae8f4e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-639261941',display_name='tempest-ServersNegativeTestJSON-server-639261941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-639261941',id=13,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:51:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68afcd8a90ba42bd860204d31efae7e0',ramdisk_id='',reservation_id='r-j3azbg0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1371271005',owner_user_name='tempest-ServersNegativeTestJSON-1371271005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:51:14Z,user_data=None,user_id='983ee707e2eb4a2ba4617f91d810011d',uuid=55765bdd-d12d-4466-af2b-6912e5ae8f4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "address": "fa:16:3e:d8:6d:e9", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa654ff6e-44", "ovs_interfaceid": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converting VIF {"id": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "address": "fa:16:3e:d8:6d:e9", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa654ff6e-44", "ovs_interfaceid": "a654ff6e-44f7-4b7f-bc96-2347309fd33a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6d:e9,bridge_name='br-int',has_traffic_filtering=True,id=a654ff6e-44f7-4b7f-bc96-2347309fd33a,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa654ff6e-44') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG os_vif [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6d:e9,bridge_name='br-int',has_traffic_filtering=True,id=a654ff6e-44f7-4b7f-bc96-2347309fd33a,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa654ff6e-44') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa654ff6e-44, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0078e1db-69c4-4fd4-babc-46bad6f22d41) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:52:57 user nova-compute[76161]: INFO os_vif [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6d:e9,bridge_name='br-int',has_traffic_filtering=True,id=a654ff6e-44f7-4b7f-bc96-2347309fd33a,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa654ff6e-44')
Nov 14 17:52:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Deleting instance files /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e_del
Nov 14 17:52:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Deletion of /opt/stack/data/nova/instances/55765bdd-d12d-4466-af2b-6912e5ae8f4e_del complete
Nov 14 17:52:57 user nova-compute[76161]: INFO nova.compute.manager [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 14 17:52:57 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:57 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Took 1.46 seconds to deallocate network for instance.
Nov 14 17:52:57 user nova-compute[76161]: WARNING nova.volume.cinder [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Attachment 5bc97f6d-518a-4866-9938-0fb64fc54589 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5bc97f6d-518a-4866-9938-0fb64fc54589. (HTTP 404) (Request-ID: req-3989dc5d-8c84-4438-918f-0c214c69002c)
Nov 14 17:52:57 user nova-compute[76161]: INFO nova.compute.manager [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received event network-vif-plugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] Acquiring lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] No waiting events found dispatching network-vif-plugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:57 user nova-compute[76161]: WARNING nova.compute.manager [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received unexpected event network-vif-plugged-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 for instance with vm_state active and task_state deleting.
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Received event network-vif-unplugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] Acquiring lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] No waiting events found dispatching network-vif-unplugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Received event network-vif-unplugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Received event network-vif-plugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] Acquiring lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] No waiting events found dispatching network-vif-plugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:52:57 user nova-compute[76161]: WARNING nova.compute.manager [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Received unexpected event network-vif-plugged-a654ff6e-44f7-4b7f-bc96-2347309fd33a for instance with vm_state active and task_state deleting.
Nov 14 17:52:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-4ebff7f5-43a9-46b1-a6f0-a45ecb043148 req-e6c54fdd-4d48-463a-bd2b-2625c34c59f2 service nova] [instance: 2ade3f5e-24a0-4989-854a-f4a90e5cf30a] Received event network-vif-deleted-9e624cc1-9ddd-4a4d-924d-1aecdcc84c90 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:58 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Took 0.48 seconds to deallocate network for instance.
Nov 14 17:52:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-31647118-6f50-47d5-b48f-0c735d89861e req-62c7d0dc-8b56-4cd2-a0c0-a1c7e9ef2d59 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Received event network-vif-deleted-a654ff6e-44f7-4b7f-bc96-2347309fd33a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:52:58 user nova-compute[76161]: INFO nova.compute.manager [req-31647118-6f50-47d5-b48f-0c735d89861e req-62c7d0dc-8b56-4cd2-a0c0-a1c7e9ef2d59 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Neutron deleted interface a654ff6e-44f7-4b7f-bc96-2347309fd33a; detaching it from the instance and deleting it from the info cache
Nov 14 17:52:58 user nova-compute[76161]: DEBUG nova.network.neutron [req-31647118-6f50-47d5-b48f-0c735d89861e req-62c7d0dc-8b56-4cd2-a0c0-a1c7e9ef2d59 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-31647118-6f50-47d5-b48f-0c735d89861e req-62c7d0dc-8b56-4cd2-a0c0-a1c7e9ef2d59 service nova] [instance: 55765bdd-d12d-4466-af2b-6912e5ae8f4e] Detach interface failed, port_id=a654ff6e-44f7-4b7f-bc96-2347309fd33a, reason: Instance 55765bdd-d12d-4466-af2b-6912e5ae8f4e could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.124s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:52:58 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Deleted allocations for instance 2ade3f5e-24a0-4989-854a-f4a90e5cf30a
Nov 14 17:52:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-22a40a38-413f-4527-854d-3ecd70dc86fa tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "2ade3f5e-24a0-4989-854a-f4a90e5cf30a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.032s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:52:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:58 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Deleted allocations for instance 55765bdd-d12d-4466-af2b-6912e5ae8f4e
Nov 14 17:52:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e93ca64a-9d77-43fb-b2f8-4ba7cbfb1711 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "55765bdd-d12d-4466-af2b-6912e5ae8f4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:52:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lazy-loading 'flavor' on Instance uuid 56f47238-81fe-4196-865c-e1ad68cf6fea {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:05 user nova-compute[76161]: INFO nova.compute.manager [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Attaching volume d96c39a9-1a04-42d8-8ae6-7738ced041a1 to /dev/vdb
Nov 14 17:53:05 user nova-compute[76161]: DEBUG os_brick.utils [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43498fd-14c1-4d43-a286-ff6c752fad76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b189e62d-7ae3-4d06-a79d-c3d7a13a0a98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d1d81f-5aac-45ff-b775-5cd19d42941c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acf61cd-9a54-4884-b9c5-765ed7de8de4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:53:05 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:53:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed2e39a-4d5c-45e9-9ebf-6bad248134d2]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG os_brick.utils [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:53:05 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating existing volume attachment record: 1b2a77c5-5c38-4430-8f14-6ae1ec08d090 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:53:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:53:10 user nova-compute[76161]: INFO nova.compute.claims [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Claim successful on node user
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:53:10 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.policy [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbfeb35beb394e15bf881780f69724f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4467aca672a34c1a8f4e1735636d311b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:53:10 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Creating image(s)
Nov 14 17:53:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "/opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "/opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "/opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:53:11 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:53:11 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:53:11 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e11df4-5805-496b-bf41-f74549630e18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:53:11 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca03e59-2622-4300-b81b-228696402bd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1] added
Nov 14 17:53:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.126s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe258545-28d3-4c1b-8a81-6fe1d94c5d3c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.258s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[58743c1e-b9ce-4525-8ec4-145661302a4f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgBeLnrW {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgBeLnrW" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14bf241-4685-4bb7-91ce-b61246adbfd5]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgBeLnrW'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaf4fa6-31b0-4ff7-8d5c-8b5ffe47e0ea]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[40698a16-56b7-4652-b998-078bc6bd6042]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:11 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:11 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a200d3-7965-4657-b0fb-3436e26bda7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]
Nov 14 17:53:11 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.
Nov 14 17:53:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44d96f4-24df-4a27-8fac-22b952d4a706]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk 1073741824" returned: 0 in 0.068s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f7971f-886a-43a8-a565-b1c990321074]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:11 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:11 user nova-compute[76161]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:53:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:11 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:11 user nova-compute[76161]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:53:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.498s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acefb31-bc21-4aaf-866a-470a1bd41a9e]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Successfully created port: b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.206s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Cannot resize image /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Ensure instance console log exists: /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Successfully updated port: b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "refresh_cache-56848a92-97b3-4eef-b924-de8ab85ad115" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquired lock "refresh_cache-56848a92-97b3-4eef-b924-de8ab85ad115" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-17a7112f-b6e3-453f-adac-34b946d9ecff req-c5cfd273-9515-4d03-a45a-845acab40381 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-changed-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-17a7112f-b6e3-453f-adac-34b946d9ecff req-c5cfd273-9515-4d03-a45a-845acab40381 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Refreshing instance network info cache due to event network-changed-b2487e15-e0cf-4079-9baf-f522396ce976. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-17a7112f-b6e3-453f-adac-34b946d9ecff req-c5cfd273-9515-4d03-a45a-845acab40381 service nova] Acquiring lock "refresh_cache-56848a92-97b3-4eef-b924-de8ab85ad115" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.543s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] <== connect_volume: return (1546ms) {'type': 'block', 'scsi_wwn': '23334346433653232', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334346433653232', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lazy-loading 'flavor' on Instance uuid 56f47238-81fe-4196-865c-e1ad68cf6fea {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updating instance_info_cache with network_info: [{"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:53:12 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:53:12 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 17:53:12 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:53:12 user nova-compute[76161]:   <serial>d96c39a9-1a04-42d8-8ae6-7738ced041a1</serial>
Nov 14 17:53:12 user nova-compute[76161]: </disk>
Nov 14 17:53:12 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Updating instance_info_cache with network_info: [{"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Releasing lock "refresh_cache-56848a92-97b3-4eef-b924-de8ab85ad115" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Instance network_info: |[{"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-17a7112f-b6e3-453f-adac-34b946d9ecff req-c5cfd273-9515-4d03-a45a-845acab40381 service nova] Acquired lock "refresh_cache-56848a92-97b3-4eef-b924-de8ab85ad115" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.neutron [req-17a7112f-b6e3-453f-adac-34b946d9ecff req-c5cfd273-9515-4d03-a45a-845acab40381 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Refreshing network info cache for port b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Start _get_guest_xml network_info=[{"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:53:12 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:12 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1095895513',display_name='tempest-tempest.common.compute-instance-1095895513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1095895513',id=17,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnUVlrrKY796M2WQb0to34mVHtH8sawDJDiNWfGFXurDBDBklAQgDqd8pjjgIb+0Unj5c6grIFHGUanM3AOdi9gBLjHVsWn12jK6zqkIeGTVVB8fkRDE79sNBqkLYZt1g==',key_name='tempest-keypair-916935358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-byfwoe9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=56848a92-97b3-4eef-b924-de8ab85ad115,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'pci_devices' on Instance uuid 56848a92-97b3-4eef-b924-de8ab85ad115 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:53:12 user nova-compute[76161]:   <uuid>56848a92-97b3-4eef-b924-de8ab85ad115</uuid>
Nov 14 17:53:12 user nova-compute[76161]:   <name>instance-00000011</name>
Nov 14 17:53:12 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:53:12 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:53:12 user nova-compute[76161]:   <metadata>
Nov 14 17:53:12 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:53:12 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:53:12 user nova-compute[76161]:       <nova:name>tempest-tempest.common.compute-instance-1095895513</nova:name>
Nov 14 17:53:12 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:53:12</nova:creationTime>
Nov 14 17:53:12 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:53:12 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:53:12 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:53:12 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:53:12 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:53:12 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:53:12 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:53:12 user nova-compute[76161]:       <nova:owner>
Nov 14 17:53:12 user nova-compute[76161]:         <nova:user uuid="bbfeb35beb394e15bf881780f69724f6">tempest-ServerActionsTestOtherA-233736107-project-member</nova:user>
Nov 14 17:53:12 user nova-compute[76161]:         <nova:project uuid="4467aca672a34c1a8f4e1735636d311b">tempest-ServerActionsTestOtherA-233736107</nova:project>
Nov 14 17:53:12 user nova-compute[76161]:       </nova:owner>
Nov 14 17:53:12 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:53:12 user nova-compute[76161]:       <nova:ports>
Nov 14 17:53:12 user nova-compute[76161]:         <nova:port uuid="b2487e15-e0cf-4079-9baf-f522396ce976">
Nov 14 17:53:12 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 17:53:12 user nova-compute[76161]:         </nova:port>
Nov 14 17:53:12 user nova-compute[76161]:       </nova:ports>
Nov 14 17:53:12 user nova-compute[76161]:     </nova:instance>
Nov 14 17:53:12 user nova-compute[76161]:   </metadata>
Nov 14 17:53:12 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:53:12 user nova-compute[76161]:     <system>
Nov 14 17:53:12 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:53:12 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:53:12 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:53:12 user nova-compute[76161]:       <entry name="serial">56848a92-97b3-4eef-b924-de8ab85ad115</entry>
Nov 14 17:53:12 user nova-compute[76161]:       <entry name="uuid">56848a92-97b3-4eef-b924-de8ab85ad115</entry>
Nov 14 17:53:12 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:53:12 user nova-compute[76161]:     </system>
Nov 14 17:53:12 user nova-compute[76161]:   </sysinfo>
Nov 14 17:53:12 user nova-compute[76161]:   <os>
Nov 14 17:53:12 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:53:12 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:53:12 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:53:12 user nova-compute[76161]:   </os>
Nov 14 17:53:12 user nova-compute[76161]:   <features>
Nov 14 17:53:12 user nova-compute[76161]:     <acpi/>
Nov 14 17:53:12 user nova-compute[76161]:     <apic/>
Nov 14 17:53:12 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:53:12 user nova-compute[76161]:   </features>
Nov 14 17:53:12 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:53:12 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:53:12 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:53:12 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:53:12 user nova-compute[76161]:   </clock>
Nov 14 17:53:12 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:53:12 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:53:12 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:53:12 user nova-compute[76161]:   </cpu>
Nov 14 17:53:12 user nova-compute[76161]:   <devices>
Nov 14 17:53:12 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:53:12 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:53:12 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk"/>
Nov 14 17:53:12 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:53:12 user nova-compute[76161]:     </disk>
Nov 14 17:53:12 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:53:12 user nova-compute[76161]:       <mac address="fa:16:3e:46:2d:e4"/>
Nov 14 17:53:12 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:53:12 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:53:12 user nova-compute[76161]:       <target dev="tapb2487e15-e0"/>
Nov 14 17:53:12 user nova-compute[76161]:     </interface>
Nov 14 17:53:12 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:53:12 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/console.log" append="off"/>
Nov 14 17:53:12 user nova-compute[76161]:     </serial>
Nov 14 17:53:12 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:53:12 user nova-compute[76161]:     <video>
Nov 14 17:53:12 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:53:12 user nova-compute[76161]:     </video>
Nov 14 17:53:12 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:53:12 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:53:12 user nova-compute[76161]:     </rng>
Nov 14 17:53:12 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:53:12 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:53:12 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:53:12 user nova-compute[76161]:     </memballoon>
Nov 14 17:53:12 user nova-compute[76161]:   </devices>
Nov 14 17:53:12 user nova-compute[76161]: </domain>
Nov 14 17:53:12 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1095895513',display_name='tempest-tempest.common.compute-instance-1095895513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1095895513',id=17,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnUVlrrKY796M2WQb0to34mVHtH8sawDJDiNWfGFXurDBDBklAQgDqd8pjjgIb+0Unj5c6grIFHGUanM3AOdi9gBLjHVsWn12jK6zqkIeGTVVB8fkRDE79sNBqkLYZt1g==',key_name='tempest-keypair-916935358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-byfwoe9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=56848a92-97b3-4eef-b924-de8ab85ad115,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG os_vif [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9031a311-deff-517b-abb7-0b5ea9a21c13', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2487e15-e0, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2487e15-e0, col_values=(('qos', UUID('a8e202e8-719a-49ca-a0b7-1feb5b2bec31')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2487e15-e0, col_values=(('external_ids', {'iface-id': 'b2487e15-e0cf-4079-9baf-f522396ce976', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:2d:e4', 'vm-uuid': '56848a92-97b3-4eef-b924-de8ab85ad115'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:12 user nova-compute[76161]: INFO os_vif [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0')
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:53:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No VIF found with MAC fa:16:3e:46:2d:e4, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] No VIF found with MAC fa:16:3e:27:c8:17, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0d7fe44b-46a8-4b60-877d-b9857955423a tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.458s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG nova.network.neutron [req-17a7112f-b6e3-453f-adac-34b946d9ecff req-c5cfd273-9515-4d03-a45a-845acab40381 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Updated VIF entry in instance network info cache for port b2487e15-e0cf-4079-9baf-f522396ce976. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG nova.network.neutron [req-17a7112f-b6e3-453f-adac-34b946d9ecff req-c5cfd273-9515-4d03-a45a-845acab40381 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Updating instance_info_cache with network_info: [{"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-17a7112f-b6e3-453f-adac-34b946d9ecff req-c5cfd273-9515-4d03-a45a-845acab40381 service nova] Releasing lock "refresh_cache-56848a92-97b3-4eef-b924-de8ab85ad115" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-2f449adf-0ff0-4a41-8747-a4c2af10c6ce req-8a7dcec9-c562-4ee0-8540-35a17a45a4ff service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2f449adf-0ff0-4a41-8747-a4c2af10c6ce req-8a7dcec9-c562-4ee0-8540-35a17a45a4ff service nova] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2f449adf-0ff0-4a41-8747-a4c2af10c6ce req-8a7dcec9-c562-4ee0-8540-35a17a45a4ff service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2f449adf-0ff0-4a41-8747-a4c2af10c6ce req-8a7dcec9-c562-4ee0-8540-35a17a45a4ff service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-2f449adf-0ff0-4a41-8747-a4c2af10c6ce req-8a7dcec9-c562-4ee0-8540-35a17a45a4ff service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] No waiting events found dispatching network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:14 user nova-compute[76161]: WARNING nova.compute.manager [req-2f449adf-0ff0-4a41-8747-a4c2af10c6ce req-8a7dcec9-c562-4ee0-8540-35a17a45a4ff service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received unexpected event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 for instance with vm_state building and task_state spawning.
Nov 14 17:53:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Stashing vm_state: active {{(pid=76161) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:53:15 user nova-compute[76161]: INFO nova.compute.claims [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Claim successful on node user
Nov 14 17:53:15 user nova-compute[76161]: INFO nova.compute.resource_tracker [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating resource usage from migration bf20f369-2efa-413f-bf27-d76d1098bcf1
Nov 14 17:53:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:53:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.670s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:16 user nova-compute[76161]: INFO nova.compute.manager [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Migrating
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquired lock "compute-rpcapi-router" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:16 user nova-compute[76161]: INFO nova.compute.rpcapi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Releasing lock "compute-rpcapi-router" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquired lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:53:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Instance spawned successfully.
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:16 user nova-compute[76161]: INFO nova.compute.manager [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.compute.manager [req-49e0d1ca-a44d-4beb-9eea-88da01d38514 req-09bb4497-09fc-4459-9f0c-7851366feac0 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-49e0d1ca-a44d-4beb-9eea-88da01d38514 req-09bb4497-09fc-4459-9f0c-7851366feac0 service nova] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-49e0d1ca-a44d-4beb-9eea-88da01d38514 req-09bb4497-09fc-4459-9f0c-7851366feac0 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-49e0d1ca-a44d-4beb-9eea-88da01d38514 req-09bb4497-09fc-4459-9f0c-7851366feac0 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG nova.compute.manager [req-49e0d1ca-a44d-4beb-9eea-88da01d38514 req-09bb4497-09fc-4459-9f0c-7851366feac0 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] No waiting events found dispatching network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:16 user nova-compute[76161]: WARNING nova.compute.manager [req-49e0d1ca-a44d-4beb-9eea-88da01d38514 req-09bb4497-09fc-4459-9f0c-7851366feac0 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received unexpected event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 for instance with vm_state building and task_state spawning.
Nov 14 17:53:16 user nova-compute[76161]: INFO nova.compute.manager [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Took 6.71 seconds to build instance.
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2419cd19-e548-4439-a3a8-e39903e1d684 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.816s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating instance_info_cache with network_info: [{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Releasing lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Starting migrate_disk_and_power_off {{(pid=76161) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:18 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance destroyed successfully.
Nov 14 17:53:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-412733385',display_name='tempest-ServerActionsTestOtherB-server-412733385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-412733385',id=4,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0NZD4kqQvyUmQDlStvq04ezcWsfIyD0A/bWacUhJpYz5fcS1f2SC6UBuTPRJ8HEnEXX6nzxYwzXvCIrkT+ksrUBvLI5jLRbrB40MHHEGW3qMOyOEwSYMvxHD0HaK5eqA==',key_name='tempest-keypair-1585564500',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d05c015b22d142de91f43f92f00fe8f5',ramdisk_id='',reservation_id='r-ixxlkxwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2076940630',owner_user_name='tempest-ServerActionsTestOtherB-2076940630-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdcf024ba5d2481aad966acad37d9275',uuid=56f47238-81fe-4196-865c-e1ad68cf6fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884427334-network", "vif_mac": "fa:16:3e:27:c8:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converting VIF {"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884427334-network", "vif_mac": "fa:16:3e:27:c8:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_vif [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39b86458-3c, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82515976-a8c8-4ddd-a0e6-29f94d71ba34) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:18 user nova-compute[76161]: INFO os_vif [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c')
Nov 14 17:53:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:53:18 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e49d984-dba2-4728-88d0-d2f3c58d0089]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:53:18 user nova-compute[76161]: No targets found.
Nov 14 17:53:18 user nova-compute[76161]: iSNS:
Nov 14 17:53:18 user nova-compute[76161]: No targets found.
Nov 14 17:53:18 user nova-compute[76161]: STATIC:
Nov 14 17:53:18 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc
Nov 14 17:53:18 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:53:18 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:53:18 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:53:18 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:53:18 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:53:18 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:53:18 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:53:18 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:53:18 user nova-compute[76161]: FIRMWARE:
Nov 14 17:53:18 user nova-compute[76161]: No targets found.
Nov 14 17:53:18 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:53:18 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:53:18 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f0f87e-f55f-41b0-87df-d4454ce950b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbe3b94-7982-41b2-969f-50159a6e20da]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:18 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:18 user nova-compute[76161]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:53:18 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:18 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:18 user nova-compute[76161]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:53:18 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f803dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82cfc06-58d2-44ce-8c7a-4141b4f345e8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdceb988-ca69-4faa-a47b-0f1a96c81b87]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:19 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:19 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7653MB free_disk=25.52083969116211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f4288f-0f62-4b77-8abf-b703b007cf30]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a646aafe-cc12-41d8-90e4-27452f62c4dd]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[915c2ebb-27f5-4529-9c1d-6e306c60acd1]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Applying migration context for instance 56f47238-81fe-4196-865c-e1ad68cf6fea as it has an incoming, in-progress migration bf20f369-2efa-413f-bf27-d76d1098bcf1. Migration status is migrating {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 17:53:19 user nova-compute[76161]: INFO nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating resource usage from migration bf20f369-2efa-413f-bf27-d76d1098bcf1
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a950a294-17a2-42a2-9281-2db9c61676e4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]
Nov 14 17:53:19 user nova-compute[76161]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.
Nov 14 17:53:19 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 678e458a-aeb6-4f29-b20b-74115179025f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 32fb9960-faa6-443a-88d3-3ee3c68b27fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 8b08db54-6a49-41fa-a188-d41593d91cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b37a7f95-b429-431a-b837-a650fd1ee27e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56848a92-97b3-4eef-b924-de8ab85ad115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Migration bf20f369-2efa-413f-bf27-d76d1098bcf1 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56f47238-81fe-4196-865c-e1ad68cf6fea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50fbf08-0b55-4b1e-bb0e-61c9690f3c8f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.856s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] <== disconnect_volume: return (858ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea_resize/disk /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:53:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.758s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "cp -r /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea_resize/disk /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk" returned: 0 in 0.370s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea_resize/disk.info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk.info {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "cp -r /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea_resize/disk.info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk.info" returned: 0 in 0.053s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Port 39b86458-3c6f-457f-b2ba-e2f4709ffb50 binding to destination host user is already ACTIVE {{(pid=76161) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 17:53:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquired lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "76193048-410d-4a59-9eb5-165d8ce0af6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:53:22 user nova-compute[76161]: INFO nova.compute.claims [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Claim successful on node user
Nov 14 17:53:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating instance_info_cache with network_info: [{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Releasing lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG os_brick.utils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6030d7bd-199e-4e33-8baf-39925d56ce84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8febfda5-5462-4b9e-9e6b-9de463994074]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e777bc-8c83-4836-9b2e-894d366649fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb99bad5-5d83-49da-82e3-571dffd394a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:53:22 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb05c909-1b18-44e2-b66d-e6d78301bc6c]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG os_brick.utils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:53:22 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:53:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:53:22 user nova-compute[76161]: DEBUG nova.policy [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49edd5581ca44780ac590c2b072b338d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45eab8e344af47a2b1b28fa471a4acc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:53:23 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Creating image(s)
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "/opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "/opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "/opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.206s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-620b5d33-b087-4f53-83b5-63bda4a4ea51 req-3f2b1382-9754-4c7a-9c70-d7538e337f21 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-unplugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-620b5d33-b087-4f53-83b5-63bda4a4ea51 req-3f2b1382-9754-4c7a-9c70-d7538e337f21 service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-620b5d33-b087-4f53-83b5-63bda4a4ea51 req-3f2b1382-9754-4c7a-9c70-d7538e337f21 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-620b5d33-b087-4f53-83b5-63bda4a4ea51 req-3f2b1382-9754-4c7a-9c70-d7538e337f21 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-620b5d33-b087-4f53-83b5-63bda4a4ea51 req-3f2b1382-9754-4c7a-9c70-d7538e337f21 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-unplugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:23 user nova-compute[76161]: WARNING nova.compute.manager [req-620b5d33-b087-4f53-83b5-63bda4a4ea51 req-3f2b1382-9754-4c7a-9c70-d7538e337f21 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-unplugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state active and task_state resize_finish.
Nov 14 17:53:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.205s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk 1073741824" returned: 0 in 0.048s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.235s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Successfully created port: d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:53:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:24 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Cannot resize image /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:53:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:53:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Ensure instance console log exists: /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:53:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Successfully updated port: d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "refresh_cache-76193048-410d-4a59-9eb5-165d8ce0af6c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquired lock "refresh_cache-76193048-410d-4a59-9eb5-165d8ce0af6c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-e1eecda5-36fd-4200-bfac-cc7358c0e735 req-4a4e1067-1453-4559-8481-34eec22c917e service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Received event network-changed-d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-e1eecda5-36fd-4200-bfac-cc7358c0e735 req-4a4e1067-1453-4559-8481-34eec22c917e service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Refreshing instance network info cache due to event network-changed-d87d00b4-392b-4b9d-8fb3-20c3dfe59894. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e1eecda5-36fd-4200-bfac-cc7358c0e735 req-4a4e1067-1453-4559-8481-34eec22c917e service nova] Acquiring lock "refresh_cache-76193048-410d-4a59-9eb5-165d8ce0af6c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-ff09d6ba-e5cd-4471-9d1d-adafe93626ed req-1bce5db9-e1bd-4a9d-976b-1fbaea71360d service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ff09d6ba-e5cd-4471-9d1d-adafe93626ed req-1bce5db9-e1bd-4a9d-976b-1fbaea71360d service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ff09d6ba-e5cd-4471-9d1d-adafe93626ed req-1bce5db9-e1bd-4a9d-976b-1fbaea71360d service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ff09d6ba-e5cd-4471-9d1d-adafe93626ed req-1bce5db9-e1bd-4a9d-976b-1fbaea71360d service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-ff09d6ba-e5cd-4471-9d1d-adafe93626ed req-1bce5db9-e1bd-4a9d-976b-1fbaea71360d service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:25 user nova-compute[76161]: WARNING nova.compute.manager [req-ff09d6ba-e5cd-4471-9d1d-adafe93626ed req-1bce5db9-e1bd-4a9d-976b-1fbaea71360d service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state active and task_state resize_finish.
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Updating instance_info_cache with network_info: [{"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Releasing lock "refresh_cache-76193048-410d-4a59-9eb5-165d8ce0af6c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Instance network_info: |[{"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e1eecda5-36fd-4200-bfac-cc7358c0e735 req-4a4e1067-1453-4559-8481-34eec22c917e service nova] Acquired lock "refresh_cache-76193048-410d-4a59-9eb5-165d8ce0af6c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.network.neutron [req-e1eecda5-36fd-4200-bfac-cc7358c0e735 req-4a4e1067-1453-4559-8481-34eec22c917e service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Refreshing network info cache for port d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:53:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Start _get_guest_xml network_info=[{"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:53:26 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:26 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1852126971',display_name='tempest-AttachVolumeNegativeTest-server-1852126971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1852126971',id=18,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkxDmqkciezk7nmv7ve9Z75zLZQOesYe3Q27FmxijAfMJUz44IJ/xq7zGnUgc2B2rw39xEgFXCEkYWXlaZeam2cofMSEVPt4utWrlcaeRArd1sz7pQ2HmsLIMcL1Cnovg==',key_name='tempest-keypair-340133556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-ej2crvhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=76193048-410d-4a59-9eb5-165d8ce0af6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:37:1d,bridge_name='br-int',has_traffic_filtering=True,id=d87d00b4-392b-4b9d-8fb3-20c3dfe59894,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87d00b4-39') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'pci_devices' on Instance uuid 76193048-410d-4a59-9eb5-165d8ce0af6c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:53:26 user nova-compute[76161]:   <uuid>76193048-410d-4a59-9eb5-165d8ce0af6c</uuid>
Nov 14 17:53:26 user nova-compute[76161]:   <name>instance-00000012</name>
Nov 14 17:53:26 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:53:26 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:53:26 user nova-compute[76161]:   <metadata>
Nov 14 17:53:26 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:53:26 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:53:26 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1852126971</nova:name>
Nov 14 17:53:26 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:53:26</nova:creationTime>
Nov 14 17:53:26 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:53:26 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:53:26 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:53:26 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:53:26 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:53:26 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:53:26 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:53:26 user nova-compute[76161]:       <nova:owner>
Nov 14 17:53:26 user nova-compute[76161]:         <nova:user uuid="49edd5581ca44780ac590c2b072b338d">tempest-AttachVolumeNegativeTest-453609882-project-member</nova:user>
Nov 14 17:53:26 user nova-compute[76161]:         <nova:project uuid="45eab8e344af47a2b1b28fa471a4acc3">tempest-AttachVolumeNegativeTest-453609882</nova:project>
Nov 14 17:53:26 user nova-compute[76161]:       </nova:owner>
Nov 14 17:53:26 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:53:26 user nova-compute[76161]:       <nova:ports>
Nov 14 17:53:26 user nova-compute[76161]:         <nova:port uuid="d87d00b4-392b-4b9d-8fb3-20c3dfe59894">
Nov 14 17:53:26 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 17:53:26 user nova-compute[76161]:         </nova:port>
Nov 14 17:53:26 user nova-compute[76161]:       </nova:ports>
Nov 14 17:53:26 user nova-compute[76161]:     </nova:instance>
Nov 14 17:53:26 user nova-compute[76161]:   </metadata>
Nov 14 17:53:26 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:53:26 user nova-compute[76161]:     <system>
Nov 14 17:53:26 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:53:26 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:53:26 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:53:26 user nova-compute[76161]:       <entry name="serial">76193048-410d-4a59-9eb5-165d8ce0af6c</entry>
Nov 14 17:53:26 user nova-compute[76161]:       <entry name="uuid">76193048-410d-4a59-9eb5-165d8ce0af6c</entry>
Nov 14 17:53:26 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:53:26 user nova-compute[76161]:     </system>
Nov 14 17:53:26 user nova-compute[76161]:   </sysinfo>
Nov 14 17:53:26 user nova-compute[76161]:   <os>
Nov 14 17:53:26 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:53:26 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:53:26 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:53:26 user nova-compute[76161]:   </os>
Nov 14 17:53:26 user nova-compute[76161]:   <features>
Nov 14 17:53:26 user nova-compute[76161]:     <acpi/>
Nov 14 17:53:26 user nova-compute[76161]:     <apic/>
Nov 14 17:53:26 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:53:26 user nova-compute[76161]:   </features>
Nov 14 17:53:26 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:53:26 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:53:26 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:53:26 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:53:26 user nova-compute[76161]:   </clock>
Nov 14 17:53:26 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:53:26 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:53:26 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:53:26 user nova-compute[76161]:   </cpu>
Nov 14 17:53:26 user nova-compute[76161]:   <devices>
Nov 14 17:53:26 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:53:26 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:53:26 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk"/>
Nov 14 17:53:26 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:53:26 user nova-compute[76161]:     </disk>
Nov 14 17:53:26 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:53:26 user nova-compute[76161]:       <mac address="fa:16:3e:f3:37:1d"/>
Nov 14 17:53:26 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:53:26 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:53:26 user nova-compute[76161]:       <target dev="tapd87d00b4-39"/>
Nov 14 17:53:26 user nova-compute[76161]:     </interface>
Nov 14 17:53:26 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:53:26 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/console.log" append="off"/>
Nov 14 17:53:26 user nova-compute[76161]:     </serial>
Nov 14 17:53:26 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:53:26 user nova-compute[76161]:     <video>
Nov 14 17:53:26 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:53:26 user nova-compute[76161]:     </video>
Nov 14 17:53:26 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:53:26 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:53:26 user nova-compute[76161]:     </rng>
Nov 14 17:53:26 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:53:26 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:53:26 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:53:26 user nova-compute[76161]:     </memballoon>
Nov 14 17:53:26 user nova-compute[76161]:   </devices>
Nov 14 17:53:26 user nova-compute[76161]: </domain>
Nov 14 17:53:26 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1852126971',display_name='tempest-AttachVolumeNegativeTest-server-1852126971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1852126971',id=18,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkxDmqkciezk7nmv7ve9Z75zLZQOesYe3Q27FmxijAfMJUz44IJ/xq7zGnUgc2B2rw39xEgFXCEkYWXlaZeam2cofMSEVPt4utWrlcaeRArd1sz7pQ2HmsLIMcL1Cnovg==',key_name='tempest-keypair-340133556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-ej2crvhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=76193048-410d-4a59-9eb5-165d8ce0af6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:37:1d,bridge_name='br-int',has_traffic_filtering=True,id=d87d00b4-392b-4b9d-8fb3-20c3dfe59894,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87d00b4-39') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG os_vif [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:37:1d,bridge_name='br-int',has_traffic_filtering=True,id=d87d00b4-392b-4b9d-8fb3-20c3dfe59894,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87d00b4-39') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1a33364-0564-54ae-bba2-860d648a10c9', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd87d00b4-39, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd87d00b4-39, col_values=(('qos', UUID('8b39be43-743b-4341-92fd-c21ceb0e43d0')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd87d00b4-39, col_values=(('external_ids', {'iface-id': 'd87d00b4-392b-4b9d-8fb3-20c3dfe59894', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:37:1d', 'vm-uuid': '76193048-410d-4a59-9eb5-165d8ce0af6c'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:26 user nova-compute[76161]: INFO os_vif [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:37:1d,bridge_name='br-int',has_traffic_filtering=True,id=d87d00b4-392b-4b9d-8fb3-20c3dfe59894,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87d00b4-39')
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No VIF found with MAC fa:16:3e:f3:37:1d, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-e1eecda5-36fd-4200-bfac-cc7358c0e735 req-4a4e1067-1453-4559-8481-34eec22c917e service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Updated VIF entry in instance network info cache for port d87d00b4-392b-4b9d-8fb3-20c3dfe59894. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-e1eecda5-36fd-4200-bfac-cc7358c0e735 req-4a4e1067-1453-4559-8481-34eec22c917e service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Updating instance_info_cache with network_info: [{"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e1eecda5-36fd-4200-bfac-cc7358c0e735 req-4a4e1067-1453-4559-8481-34eec22c917e service nova] Releasing lock "refresh_cache-76193048-410d-4a59-9eb5-165d8ce0af6c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Starting finish_migration {{(pid=76161) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 17:53:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance directory exists: not creating {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 17:53:27 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Creating image(s)
Nov 14 17:53:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.320s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk. size=21474836480 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-4088ce26-f5b9-4524-9a9e-d78e8eff7511 req-e0beefaa-28c7-4cf1-a722-cadcb8bf9c34 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Received event network-vif-plugged-d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4088ce26-f5b9-4524-9a9e-d78e8eff7511 req-e0beefaa-28c7-4cf1-a722-cadcb8bf9c34 service nova] Acquiring lock "76193048-410d-4a59-9eb5-165d8ce0af6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4088ce26-f5b9-4524-9a9e-d78e8eff7511 req-e0beefaa-28c7-4cf1-a722-cadcb8bf9c34 service nova] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4088ce26-f5b9-4524-9a9e-d78e8eff7511 req-e0beefaa-28c7-4cf1-a722-cadcb8bf9c34 service nova] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-4088ce26-f5b9-4524-9a9e-d78e8eff7511 req-e0beefaa-28c7-4cf1-a722-cadcb8bf9c34 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] No waiting events found dispatching network-vif-plugged-d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:28 user nova-compute[76161]: WARNING nova.compute.manager [req-4088ce26-f5b9-4524-9a9e-d78e8eff7511 req-e0beefaa-28c7-4cf1-a722-cadcb8bf9c34 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Received unexpected event network-vif-plugged-d87d00b4-392b-4b9d-8fb3-20c3dfe59894 for instance with vm_state building and task_state spawning.
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk 21474836480 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk 21474836480" returned: 0 in 0.132s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Ensure instance console log exists: /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Start _get_guest_xml network_info=[{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884427334-network", "vif_mac": "fa:16:3e:27:c8:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '56f47238-81fe-4196-865c-e1ad68cf6fea', 'attached_at': '2023-11-14T17:53:28.000000', 'detached_at': '', 'volume_id': 'd96c39a9-1a04-42d8-8ae6-7738ced041a1', 'serial': 'd96c39a9-1a04-42d8-8ae6-7738ced041a1'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '3ab3c473-7b4f-4e4c-8868-a1ee902a379b', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:53:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:53:28 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:53:28 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:53:28 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebc005a-bbff-4eed-9053-f6c95d36d52d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:53:28 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[818760cf-24ae-45ba-9b83-9d38c36232b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1] added
Nov 14 17:53:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ff60c-33d9-403f-a587-504c87b60800]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c5a732-247d-4278-b123-b93ef4a7c270]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgBeLnrW {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgBeLnrW" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96af1fb-5621-4a20-bfc9-4a8b916ba8db]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgBeLnrW'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d88e9f-0015-495c-841d-6f6343d4f753]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e4ee10-fe4c-401a-83b9-4a273fbaacaa]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:28 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:28 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6bb4a9-a4b8-4af9-a6bd-37a30b97899b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]
Nov 14 17:53:28 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.
Nov 14 17:53:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae03d014-865b-40c1-9bf8-5751f2964f68]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ea0dd8-0b9c-444a-977c-49e8a2c641b3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:29 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:29 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:53:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:29 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:29 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:53:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a087d97-d876-446e-9c70-32ba1d748ce4]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:53:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23334346433653232', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334346433653232', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-412733385',display_name='tempest-ServerActionsTestOtherB-server-412733385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-412733385',id=4,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0NZD4kqQvyUmQDlStvq04ezcWsfIyD0A/bWacUhJpYz5fcS1f2SC6UBuTPRJ8HEnEXX6nzxYwzXvCIrkT+ksrUBvLI5jLRbrB40MHHEGW3qMOyOEwSYMvxHD0HaK5eqA==',key_name='tempest-keypair-1585564500',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d05c015b22d142de91f43f92f00fe8f5',ramdisk_id='',reservation_id='r-ixxlkxwq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2076940630',owner_user_name='tempest-ServerActionsTestOtherB-2076940630-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdcf024ba5d2481aad966acad37d9275',uuid=56f47238-81fe-4196-865c-e1ad68cf6fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884427334-network", "vif_mac": "fa:16:3e:27:c8:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converting VIF {"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884427334-network", "vif_mac": "fa:16:3e:27:c8:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:53:30 user nova-compute[76161]:   <uuid>56f47238-81fe-4196-865c-e1ad68cf6fea</uuid>
Nov 14 17:53:30 user nova-compute[76161]:   <name>instance-00000004</name>
Nov 14 17:53:30 user nova-compute[76161]:   <memory>2097152</memory>
Nov 14 17:53:30 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:53:30 user nova-compute[76161]:   <metadata>
Nov 14 17:53:30 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:53:30 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:53:30 user nova-compute[76161]:       <nova:name>tempest-ServerActionsTestOtherB-server-412733385</nova:name>
Nov 14 17:53:30 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:53:28</nova:creationTime>
Nov 14 17:53:30 user nova-compute[76161]:       <nova:flavor name="m1.small">
Nov 14 17:53:30 user nova-compute[76161]:         <nova:memory>2048</nova:memory>
Nov 14 17:53:30 user nova-compute[76161]:         <nova:disk>20</nova:disk>
Nov 14 17:53:30 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:53:30 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:53:30 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:53:30 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:53:30 user nova-compute[76161]:       <nova:owner>
Nov 14 17:53:30 user nova-compute[76161]:         <nova:user uuid="fdcf024ba5d2481aad966acad37d9275">tempest-ServerActionsTestOtherB-2076940630-project-member</nova:user>
Nov 14 17:53:30 user nova-compute[76161]:         <nova:project uuid="d05c015b22d142de91f43f92f00fe8f5">tempest-ServerActionsTestOtherB-2076940630</nova:project>
Nov 14 17:53:30 user nova-compute[76161]:       </nova:owner>
Nov 14 17:53:30 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:53:30 user nova-compute[76161]:       <nova:ports>
Nov 14 17:53:30 user nova-compute[76161]:         <nova:port uuid="39b86458-3c6f-457f-b2ba-e2f4709ffb50">
Nov 14 17:53:30 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 17:53:30 user nova-compute[76161]:         </nova:port>
Nov 14 17:53:30 user nova-compute[76161]:       </nova:ports>
Nov 14 17:53:30 user nova-compute[76161]:     </nova:instance>
Nov 14 17:53:30 user nova-compute[76161]:   </metadata>
Nov 14 17:53:30 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:53:30 user nova-compute[76161]:     <system>
Nov 14 17:53:30 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:53:30 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:53:30 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:53:30 user nova-compute[76161]:       <entry name="serial">56f47238-81fe-4196-865c-e1ad68cf6fea</entry>
Nov 14 17:53:30 user nova-compute[76161]:       <entry name="uuid">56f47238-81fe-4196-865c-e1ad68cf6fea</entry>
Nov 14 17:53:30 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:53:30 user nova-compute[76161]:     </system>
Nov 14 17:53:30 user nova-compute[76161]:   </sysinfo>
Nov 14 17:53:30 user nova-compute[76161]:   <os>
Nov 14 17:53:30 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:53:30 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:53:30 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:53:30 user nova-compute[76161]:   </os>
Nov 14 17:53:30 user nova-compute[76161]:   <features>
Nov 14 17:53:30 user nova-compute[76161]:     <acpi/>
Nov 14 17:53:30 user nova-compute[76161]:     <apic/>
Nov 14 17:53:30 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:53:30 user nova-compute[76161]:   </features>
Nov 14 17:53:30 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:53:30 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:53:30 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:53:30 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:53:30 user nova-compute[76161]:   </clock>
Nov 14 17:53:30 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:53:30 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:53:30 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:53:30 user nova-compute[76161]:   </cpu>
Nov 14 17:53:30 user nova-compute[76161]:   <devices>
Nov 14 17:53:30 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:53:30 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:53:30 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk"/>
Nov 14 17:53:30 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:53:30 user nova-compute[76161]:     </disk>
Nov 14 17:53:30 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:53:30 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:53:30 user nova-compute[76161]:       <source dev="/dev/sdc"/>
Nov 14 17:53:30 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 17:53:30 user nova-compute[76161]:       <serial>d96c39a9-1a04-42d8-8ae6-7738ced041a1</serial>
Nov 14 17:53:30 user nova-compute[76161]:     </disk>
Nov 14 17:53:30 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:53:30 user nova-compute[76161]:       <mac address="fa:16:3e:27:c8:17"/>
Nov 14 17:53:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:53:30 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:53:30 user nova-compute[76161]:       <target dev="tap39b86458-3c"/>
Nov 14 17:53:30 user nova-compute[76161]:     </interface>
Nov 14 17:53:30 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:53:30 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/console.log" append="off"/>
Nov 14 17:53:30 user nova-compute[76161]:     </serial>
Nov 14 17:53:30 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:53:30 user nova-compute[76161]:     <video>
Nov 14 17:53:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:53:30 user nova-compute[76161]:     </video>
Nov 14 17:53:30 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:53:30 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:53:30 user nova-compute[76161]:     </rng>
Nov 14 17:53:30 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:53:30 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:53:30 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:53:30 user nova-compute[76161]:     </memballoon>
Nov 14 17:53:30 user nova-compute[76161]:   </devices>
Nov 14 17:53:30 user nova-compute[76161]: </domain>
Nov 14 17:53:30 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-412733385',display_name='tempest-ServerActionsTestOtherB-server-412733385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-412733385',id=4,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0NZD4kqQvyUmQDlStvq04ezcWsfIyD0A/bWacUhJpYz5fcS1f2SC6UBuTPRJ8HEnEXX6nzxYwzXvCIrkT+ksrUBvLI5jLRbrB40MHHEGW3qMOyOEwSYMvxHD0HaK5eqA==',key_name='tempest-keypair-1585564500',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d05c015b22d142de91f43f92f00fe8f5',ramdisk_id='',reservation_id='r-ixxlkxwq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2076940630',owner_user_name='tempest-ServerActionsTestOtherB-2076940630-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdcf024ba5d2481aad966acad37d9275',uuid=56f47238-81fe-4196-865c-e1ad68cf6fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884427334-network", "vif_mac": "fa:16:3e:27:c8:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converting VIF {"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884427334-network", "vif_mac": "fa:16:3e:27:c8:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG os_vif [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82001577-839c-52ad-839d-3a9eb403b664', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39b86458-3c, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39b86458-3c, col_values=(('qos', UUID('fd8a4b06-eb82-4eca-ab97-706e480df952')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39b86458-3c, col_values=(('external_ids', {'iface-id': '39b86458-3c6f-457f-b2ba-e2f4709ffb50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:c8:17', 'vm-uuid': '56f47238-81fe-4196-865c-e1ad68cf6fea'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:30 user nova-compute[76161]: INFO os_vif [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c')
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:53:30 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Instance spawned successfully.
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] No VIF found with MAC fa:16:3e:27:c8:17, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:53:30 user nova-compute[76161]: INFO nova.compute.manager [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Took 7.27 seconds to spawn the instance on the hypervisor.
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:53:30 user nova-compute[76161]: INFO nova.compute.manager [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Took 8.38 seconds to build instance.
Nov 14 17:53:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d31a56d3-a317-46e2-a3b2-f66d1000e56e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.497s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-bbfcdb4f-c5c8-4b25-bedd-6b5f01e4ec93 req-4026e64c-c177-4fdd-aab5-868eb55e6b16 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Received event network-vif-plugged-d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bbfcdb4f-c5c8-4b25-bedd-6b5f01e4ec93 req-4026e64c-c177-4fdd-aab5-868eb55e6b16 service nova] Acquiring lock "76193048-410d-4a59-9eb5-165d8ce0af6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bbfcdb4f-c5c8-4b25-bedd-6b5f01e4ec93 req-4026e64c-c177-4fdd-aab5-868eb55e6b16 service nova] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bbfcdb4f-c5c8-4b25-bedd-6b5f01e4ec93 req-4026e64c-c177-4fdd-aab5-868eb55e6b16 service nova] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-bbfcdb4f-c5c8-4b25-bedd-6b5f01e4ec93 req-4026e64c-c177-4fdd-aab5-868eb55e6b16 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] No waiting events found dispatching network-vif-plugged-d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:30 user nova-compute[76161]: WARNING nova.compute.manager [req-bbfcdb4f-c5c8-4b25-bedd-6b5f01e4ec93 req-4026e64c-c177-4fdd-aab5-868eb55e6b16 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Received unexpected event network-vif-plugged-d87d00b4-392b-4b9d-8fb3-20c3dfe59894 for instance with vm_state active and task_state None.
Nov 14 17:53:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-950c9f19-fec0-4930-8374-a43af5977ea9 req-0c224e1b-a793-460d-a1d5-3d912ecd9f23 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-950c9f19-fec0-4930-8374-a43af5977ea9 req-0c224e1b-a793-460d-a1d5-3d912ecd9f23 service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-950c9f19-fec0-4930-8374-a43af5977ea9 req-0c224e1b-a793-460d-a1d5-3d912ecd9f23 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-950c9f19-fec0-4930-8374-a43af5977ea9 req-0c224e1b-a793-460d-a1d5-3d912ecd9f23 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-950c9f19-fec0-4930-8374-a43af5977ea9 req-0c224e1b-a793-460d-a1d5-3d912ecd9f23 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:32 user nova-compute[76161]: WARNING nova.compute.manager [req-950c9f19-fec0-4930-8374-a43af5977ea9 req-0c224e1b-a793-460d-a1d5-3d912ecd9f23 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state active and task_state resize_finish.
Nov 14 17:53:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:32 user nova-compute[76161]: INFO nova.compute.manager [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Terminating instance
Nov 14 17:53:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-b9ce5334-5472-4e02-8a24-b6abeee8334b req-cb263e3a-8836-4f2e-b5ef-9ffec0098655 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-vif-unplugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b9ce5334-5472-4e02-8a24-b6abeee8334b req-cb263e3a-8836-4f2e-b5ef-9ffec0098655 service nova] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b9ce5334-5472-4e02-8a24-b6abeee8334b req-cb263e3a-8836-4f2e-b5ef-9ffec0098655 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b9ce5334-5472-4e02-8a24-b6abeee8334b req-cb263e3a-8836-4f2e-b5ef-9ffec0098655 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-b9ce5334-5472-4e02-8a24-b6abeee8334b req-cb263e3a-8836-4f2e-b5ef-9ffec0098655 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] No waiting events found dispatching network-vif-unplugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-b9ce5334-5472-4e02-8a24-b6abeee8334b req-cb263e3a-8836-4f2e-b5ef-9ffec0098655 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-vif-unplugged-8180a18a-275a-422b-bc71-e1846af90d29 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:33 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Instance destroyed successfully.
Nov 14 17:53:33 user nova-compute[76161]: DEBUG nova.objects.instance [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lazy-loading 'resources' on Instance uuid 32fb9960-faa6-443a-88d3-3ee3c68b27fe {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-655941733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-666366678',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0qfeGCNZ8gGzIgerfVDfT/REFNEKBmHXss/bGsLZbbzc6KURhywrEepQWnmaphwMEjeaXsblW4CfozsJdXaIg0LiAQIBG9pM3LmTWPAIyPcUriJ85J0I8eim3SdheLFg==',key_name='tempest-keypair-279762098',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:52:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1801c743af0c4de098b6f24fd98c3d89',ramdisk_id='',reservation_id='r-pg3zw022',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1345728502',owner_user_name='tempest-ServerActionsV293TestJSON-1345728502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:52:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e682032e8b74286b9cc47624f3f4ae0',uuid=32fb9960-faa6-443a-88d3-3ee3c68b27fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converting VIF {"id": "8180a18a-275a-422b-bc71-e1846af90d29", "address": "fa:16:3e:26:2c:18", "network": {"id": "bdf91322-c34a-478b-ab5f-dd547e33626a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1436365280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1801c743af0c4de098b6f24fd98c3d89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8180a18a-27", "ovs_interfaceid": "8180a18a-275a-422b-bc71-e1846af90d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_vif [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8180a18a-27, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=001265b7-2f09-4368-9b34-1fff4519be8d) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:33 user nova-compute[76161]: INFO os_vif [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:18,bridge_name='br-int',has_traffic_filtering=True,id=8180a18a-275a-422b-bc71-e1846af90d29,network=Network(bdf91322-c34a-478b-ab5f-dd547e33626a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8180a18a-27')
Nov 14 17:53:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqZhQwgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:53:33 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdc477e-54b4-44e7-b199-050ba4fbc5b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:53:33 user nova-compute[76161]: No targets found.
Nov 14 17:53:33 user nova-compute[76161]: iSNS:
Nov 14 17:53:33 user nova-compute[76161]: No targets found.
Nov 14 17:53:33 user nova-compute[76161]: STATIC:
Nov 14 17:53:33 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc
Nov 14 17:53:33 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:53:33 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:53:33 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:53:33 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:53:33 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:53:33 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:53:33 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:53:33 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:53:33 user nova-compute[76161]: FIRMWARE:
Nov 14 17:53:33 user nova-compute[76161]: No targets found.
Nov 14 17:53:33 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:53:33 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:53:33 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ec4ffd-c032-45dc-8079-facf7708035b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[255f03a0-1ad7-4063-98ca-f1ab4759b828]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:33 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:33 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:53:33 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc (non-flash)
Nov 14 17:53:33 user nova-compute[76161]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:53:33 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:53:33 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f01b17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0182f98e-8e01-4199-a634-784f015d4461]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b92586-fcf0-4f95-9af1-f94f439ab82b]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eae2f56-2fc1-4105-a6ce-51bd2c68c347]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.089s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e980f0-5be8-4a64-82c4-07832e65c382]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO22293872-444cd0eb01a54dc7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_22293872', '/dev/disk/by-id/scsi-23434346364306562') {{(pid=86560) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d8b8f9-864d-4f07-ace8-0b24861bc33c]: (4, None) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a740214-2257-4b64-9411-93af33ab17c9]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df23e2c-be24-4d96-9a3b-01976f69569a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260]
Nov 14 17:53:34 user nova-compute[76161]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc, portal: 172.16.0.220,3260] successful.
Nov 14 17:53:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c755112f-0941-40de-a17b-9d0c182004dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[71950a1f-f2da-48d6-8105-dbd41337e96c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] <== disconnect_volume: return (469ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:53:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Deleting instance files /opt/stack/data/nova/instances/32fb9960-faa6-443a-88d3-3ee3c68b27fe_del
Nov 14 17:53:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Deletion of /opt/stack/data/nova/instances/32fb9960-faa6-443a-88d3-3ee3c68b27fe_del complete
Nov 14 17:53:34 user nova-compute[76161]: INFO nova.compute.manager [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Took 1.46 seconds to destroy the instance on the hypervisor.
Nov 14 17:53:34 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-29fb82fb-503c-4841-80b7-8ac2209567f7 req-ed14d27f-361b-4450-ba43-01525bc5be5e service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-29fb82fb-503c-4841-80b7-8ac2209567f7 req-ed14d27f-361b-4450-ba43-01525bc5be5e service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-29fb82fb-503c-4841-80b7-8ac2209567f7 req-ed14d27f-361b-4450-ba43-01525bc5be5e service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-29fb82fb-503c-4841-80b7-8ac2209567f7 req-ed14d27f-361b-4450-ba43-01525bc5be5e service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-29fb82fb-503c-4841-80b7-8ac2209567f7 req-ed14d27f-361b-4450-ba43-01525bc5be5e service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:34 user nova-compute[76161]: WARNING nova.compute.manager [req-29fb82fb-503c-4841-80b7-8ac2209567f7 req-ed14d27f-361b-4450-ba43-01525bc5be5e service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state active and task_state resize_finish.
Nov 14 17:53:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:53:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance running successfully.
Nov 14 17:53:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Failed to set time: agent not configured {{(pid=76161) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-605cde87-3d62-425e-9bfe-42da4609747c tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] finish_migration finished successfully. {{(pid=76161) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 17:53:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-e7d239e4-632e-45f6-9438-34a50e50af85 req-94f37478-9796-4579-9774-6d3d53d90875 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e7d239e4-632e-45f6-9438-34a50e50af85 req-94f37478-9796-4579-9774-6d3d53d90875 service nova] Acquiring lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e7d239e4-632e-45f6-9438-34a50e50af85 req-94f37478-9796-4579-9774-6d3d53d90875 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e7d239e4-632e-45f6-9438-34a50e50af85 req-94f37478-9796-4579-9774-6d3d53d90875 service nova] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-e7d239e4-632e-45f6-9438-34a50e50af85 req-94f37478-9796-4579-9774-6d3d53d90875 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] No waiting events found dispatching network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:35 user nova-compute[76161]: WARNING nova.compute.manager [req-e7d239e4-632e-45f6-9438-34a50e50af85 req-94f37478-9796-4579-9774-6d3d53d90875 service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received unexpected event network-vif-plugged-8180a18a-275a-422b-bc71-e1846af90d29 for instance with vm_state active and task_state deleting.
Nov 14 17:53:35 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:35 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Took 1.36 seconds to deallocate network for instance.
Nov 14 17:53:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-40d582f2-30f8-45dc-84b6-9060798cc770 req-ef52af77-1b6a-4157-9cf1-86de355f14ea service nova] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Received event network-vif-deleted-8180a18a-275a-422b-bc71-e1846af90d29 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:36 user nova-compute[76161]: INFO nova.compute.manager [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Took 1.07 seconds to detach 1 volumes for instance.
Nov 14 17:53:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] [instance: 32fb9960-faa6-443a-88d3-3ee3c68b27fe] Deleting volume: c755112f-0941-40de-a17b-9d0c182004dc {{(pid=76161) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 17:53:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:53:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:37 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:53:37 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:53:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.305s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:37 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:53:37 user nova-compute[76161]: INFO nova.compute.claims [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Claim successful on node user
Nov 14 17:53:37 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Deleted allocations for instance 32fb9960-faa6-443a-88d3-3ee3c68b27fe
Nov 14 17:53:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-80cade70-105f-4fa6-8273-1922ff187768 tempest-ServerActionsV293TestJSON-1345728502 tempest-ServerActionsV293TestJSON-1345728502-project-member] Lock "32fb9960-faa6-443a-88d3-3ee3c68b27fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.844s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.738s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:53:38 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:53:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:53:38 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Creating image(s)
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "/opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "/opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.195s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG nova.policy [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '470be45a97bd464b9d22b2fb6f97cf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9d6960a8574bf5879639b40b156a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.223s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk 1073741824" returned: 0 in 0.062s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Cannot resize image /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Ensure instance console log exists: /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Successfully created port: ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:53:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Successfully updated port: ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "refresh_cache-a1ec772d-0eee-460f-8f52-2daeda1a3232" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquired lock "refresh_cache-a1ec772d-0eee-460f-8f52-2daeda1a3232" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-de72bc7f-7ce3-4f0b-9877-82766a5d3092 req-0105021f-ebee-423c-883c-8eb023887b0d service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received event network-changed-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-de72bc7f-7ce3-4f0b-9877-82766a5d3092 req-0105021f-ebee-423c-883c-8eb023887b0d service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Refreshing instance network info cache due to event network-changed-ea45b27f-34f8-4051-98f1-486c4f32d35a. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-de72bc7f-7ce3-4f0b-9877-82766a5d3092 req-0105021f-ebee-423c-883c-8eb023887b0d service nova] Acquiring lock "refresh_cache-a1ec772d-0eee-460f-8f52-2daeda1a3232" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Updating instance_info_cache with network_info: [{"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Releasing lock "refresh_cache-a1ec772d-0eee-460f-8f52-2daeda1a3232" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Instance network_info: |[{"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-de72bc7f-7ce3-4f0b-9877-82766a5d3092 req-0105021f-ebee-423c-883c-8eb023887b0d service nova] Acquired lock "refresh_cache-a1ec772d-0eee-460f-8f52-2daeda1a3232" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-de72bc7f-7ce3-4f0b-9877-82766a5d3092 req-0105021f-ebee-423c-883c-8eb023887b0d service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Refreshing network info cache for port ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Start _get_guest_xml network_info=[{"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:53:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1269380355',display_name='tempest-VolumesSnapshotTestJSON-instance-1269380355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1269380355',id=19,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9zPKRGudfhPVzZH9x7YGG2DsaymnmsYFtlSC9x0PpTLea1aTHyEo2VMf6NSOnVvmZR7qKxcEs/EKAEx67O1qWlXqOZ3m38Hb40lJkPJ0BHjD44B2TIHfvn3OkaBkNW0w==',key_name='tempest-keypair-1018080940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec9d6960a8574bf5879639b40b156a86',ramdisk_id='',reservation_id='r-ire3azie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-688447987',owner_user_name='tempest-VolumesSnapshotTestJSON-688447987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='470be45a97bd464b9d22b2fb6f97cf95',uuid=a1ec772d-0eee-460f-8f52-2daeda1a3232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converting VIF {"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:99:82,bridge_name='br-int',has_traffic_filtering=True,id=ea45b27f-34f8-4051-98f1-486c4f32d35a,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea45b27f-34') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lazy-loading 'pci_devices' on Instance uuid a1ec772d-0eee-460f-8f52-2daeda1a3232 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:53:40 user nova-compute[76161]:   <uuid>a1ec772d-0eee-460f-8f52-2daeda1a3232</uuid>
Nov 14 17:53:40 user nova-compute[76161]:   <name>instance-00000013</name>
Nov 14 17:53:40 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:53:40 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:53:40 user nova-compute[76161]:   <metadata>
Nov 14 17:53:40 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:53:40 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:53:40 user nova-compute[76161]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1269380355</nova:name>
Nov 14 17:53:40 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:53:40</nova:creationTime>
Nov 14 17:53:40 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:53:40 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:53:40 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:53:40 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:53:40 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:53:40 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:53:40 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:53:40 user nova-compute[76161]:       <nova:owner>
Nov 14 17:53:40 user nova-compute[76161]:         <nova:user uuid="470be45a97bd464b9d22b2fb6f97cf95">tempest-VolumesSnapshotTestJSON-688447987-project-member</nova:user>
Nov 14 17:53:40 user nova-compute[76161]:         <nova:project uuid="ec9d6960a8574bf5879639b40b156a86">tempest-VolumesSnapshotTestJSON-688447987</nova:project>
Nov 14 17:53:40 user nova-compute[76161]:       </nova:owner>
Nov 14 17:53:40 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:53:40 user nova-compute[76161]:       <nova:ports>
Nov 14 17:53:40 user nova-compute[76161]:         <nova:port uuid="ea45b27f-34f8-4051-98f1-486c4f32d35a">
Nov 14 17:53:40 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 17:53:40 user nova-compute[76161]:         </nova:port>
Nov 14 17:53:40 user nova-compute[76161]:       </nova:ports>
Nov 14 17:53:40 user nova-compute[76161]:     </nova:instance>
Nov 14 17:53:40 user nova-compute[76161]:   </metadata>
Nov 14 17:53:40 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:53:40 user nova-compute[76161]:     <system>
Nov 14 17:53:40 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:53:40 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:53:40 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:53:40 user nova-compute[76161]:       <entry name="serial">a1ec772d-0eee-460f-8f52-2daeda1a3232</entry>
Nov 14 17:53:40 user nova-compute[76161]:       <entry name="uuid">a1ec772d-0eee-460f-8f52-2daeda1a3232</entry>
Nov 14 17:53:40 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:53:40 user nova-compute[76161]:     </system>
Nov 14 17:53:40 user nova-compute[76161]:   </sysinfo>
Nov 14 17:53:40 user nova-compute[76161]:   <os>
Nov 14 17:53:40 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:53:40 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:53:40 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:53:40 user nova-compute[76161]:   </os>
Nov 14 17:53:40 user nova-compute[76161]:   <features>
Nov 14 17:53:40 user nova-compute[76161]:     <acpi/>
Nov 14 17:53:40 user nova-compute[76161]:     <apic/>
Nov 14 17:53:40 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:53:40 user nova-compute[76161]:   </features>
Nov 14 17:53:40 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:53:40 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:53:40 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:53:40 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:53:40 user nova-compute[76161]:   </clock>
Nov 14 17:53:40 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:53:40 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:53:40 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:53:40 user nova-compute[76161]:   </cpu>
Nov 14 17:53:40 user nova-compute[76161]:   <devices>
Nov 14 17:53:40 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:53:40 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:53:40 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk"/>
Nov 14 17:53:40 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:53:40 user nova-compute[76161]:     </disk>
Nov 14 17:53:40 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:53:40 user nova-compute[76161]:       <mac address="fa:16:3e:6b:99:82"/>
Nov 14 17:53:40 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:53:40 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:53:40 user nova-compute[76161]:       <target dev="tapea45b27f-34"/>
Nov 14 17:53:40 user nova-compute[76161]:     </interface>
Nov 14 17:53:40 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:53:40 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/console.log" append="off"/>
Nov 14 17:53:40 user nova-compute[76161]:     </serial>
Nov 14 17:53:40 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:53:40 user nova-compute[76161]:     <video>
Nov 14 17:53:40 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:53:40 user nova-compute[76161]:     </video>
Nov 14 17:53:40 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:53:40 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:53:40 user nova-compute[76161]:     </rng>
Nov 14 17:53:40 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:53:40 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:53:40 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:53:40 user nova-compute[76161]:     </memballoon>
Nov 14 17:53:40 user nova-compute[76161]:   </devices>
Nov 14 17:53:40 user nova-compute[76161]: </domain>
Nov 14 17:53:40 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1269380355',display_name='tempest-VolumesSnapshotTestJSON-instance-1269380355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1269380355',id=19,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9zPKRGudfhPVzZH9x7YGG2DsaymnmsYFtlSC9x0PpTLea1aTHyEo2VMf6NSOnVvmZR7qKxcEs/EKAEx67O1qWlXqOZ3m38Hb40lJkPJ0BHjD44B2TIHfvn3OkaBkNW0w==',key_name='tempest-keypair-1018080940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec9d6960a8574bf5879639b40b156a86',ramdisk_id='',reservation_id='r-ire3azie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-688447987',owner_user_name='tempest-VolumesSnapshotTestJSON-688447987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='470be45a97bd464b9d22b2fb6f97cf95',uuid=a1ec772d-0eee-460f-8f52-2daeda1a3232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converting VIF {"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:99:82,bridge_name='br-int',has_traffic_filtering=True,id=ea45b27f-34f8-4051-98f1-486c4f32d35a,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea45b27f-34') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG os_vif [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:99:82,bridge_name='br-int',has_traffic_filtering=True,id=ea45b27f-34f8-4051-98f1-486c4f32d35a,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea45b27f-34') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0caf16a-68b7-542c-ad9e-b2cd7e66f477', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea45b27f-34, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea45b27f-34, col_values=(('qos', UUID('d4acb80a-67ce-44e2-a895-d725cdd10acd')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea45b27f-34, col_values=(('external_ids', {'iface-id': 'ea45b27f-34f8-4051-98f1-486c4f32d35a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:99:82', 'vm-uuid': 'a1ec772d-0eee-460f-8f52-2daeda1a3232'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:40 user nova-compute[76161]: INFO os_vif [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:99:82,bridge_name='br-int',has_traffic_filtering=True,id=ea45b27f-34f8-4051-98f1-486c4f32d35a,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea45b27f-34')
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:53:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] No VIF found with MAC fa:16:3e:6b:99:82, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:53:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:41 user nova-compute[76161]: DEBUG nova.network.neutron [req-de72bc7f-7ce3-4f0b-9877-82766a5d3092 req-0105021f-ebee-423c-883c-8eb023887b0d service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Updated VIF entry in instance network info cache for port ea45b27f-34f8-4051-98f1-486c4f32d35a. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:53:41 user nova-compute[76161]: DEBUG nova.network.neutron [req-de72bc7f-7ce3-4f0b-9877-82766a5d3092 req-0105021f-ebee-423c-883c-8eb023887b0d service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Updating instance_info_cache with network_info: [{"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-de72bc7f-7ce3-4f0b-9877-82766a5d3092 req-0105021f-ebee-423c-883c-8eb023887b0d service nova] Releasing lock "refresh_cache-a1ec772d-0eee-460f-8f52-2daeda1a3232" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Acquiring lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:53:45 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Instance spawned successfully.
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:53:45 user nova-compute[76161]: INFO nova.compute.claims [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Claim successful on node user
Nov 14 17:53:45 user nova-compute[76161]: INFO nova.compute.manager [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Took 7.47 seconds to spawn the instance on the hypervisor.
Nov 14 17:53:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:53:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:45 user nova-compute[76161]: INFO nova.compute.manager [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Took 8.94 seconds to build instance.
Nov 14 17:53:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6a748e92-0a28-4068-bcf7-767f35e4403e tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.075s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:53:46 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:53:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG nova.policy [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87500058da4343af8a40e9ecb0045745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d419b234844da882073df16f6d75dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:53:46 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Creating image(s)
Nov 14 17:53:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "/opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "/opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.210s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.282s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk 1073741824" returned: 0 in 0.163s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.455s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Successfully created port: d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Cannot resize image /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Ensure instance console log exists: /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-d6d3ef73-b8a3-4514-bbfd-09bf8b81c3de req-c3081ede-3b64-46f1-ace4-a176661087eb service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received event network-vif-plugged-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d6d3ef73-b8a3-4514-bbfd-09bf8b81c3de req-c3081ede-3b64-46f1-ace4-a176661087eb service nova] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d6d3ef73-b8a3-4514-bbfd-09bf8b81c3de req-c3081ede-3b64-46f1-ace4-a176661087eb service nova] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d6d3ef73-b8a3-4514-bbfd-09bf8b81c3de req-c3081ede-3b64-46f1-ace4-a176661087eb service nova] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-d6d3ef73-b8a3-4514-bbfd-09bf8b81c3de req-c3081ede-3b64-46f1-ace4-a176661087eb service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] No waiting events found dispatching network-vif-plugged-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:48 user nova-compute[76161]: WARNING nova.compute.manager [req-d6d3ef73-b8a3-4514-bbfd-09bf8b81c3de req-c3081ede-3b64-46f1-ace4-a176661087eb service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received unexpected event network-vif-plugged-ea45b27f-34f8-4051-98f1-486c4f32d35a for instance with vm_state active and task_state None.
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Successfully updated port: d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Acquiring lock "refresh_cache-f0a6ae6f-72f6-4357-8fe6-a327549d1918" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Acquired lock "refresh_cache-f0a6ae6f-72f6-4357-8fe6-a327549d1918" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-fc93775e-9054-44bf-a0c2-acf595a03df3 req-4fde6679-99a5-42d8-a38f-c006bed40be6 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Received event network-changed-d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-fc93775e-9054-44bf-a0c2-acf595a03df3 req-4fde6679-99a5-42d8-a38f-c006bed40be6 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Refreshing instance network info cache due to event network-changed-d3580c5a-1a9d-4342-8524-b95ba43e18b8. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fc93775e-9054-44bf-a0c2-acf595a03df3 req-4fde6679-99a5-42d8-a38f-c006bed40be6 service nova] Acquiring lock "refresh_cache-f0a6ae6f-72f6-4357-8fe6-a327549d1918" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Updating instance_info_cache with network_info: [{"id": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "address": "fa:16:3e:9f:1d:1b", "network": {"id": "9216f93e-0899-4614-afae-cb11f4ce634e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-955733189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8d419b234844da882073df16f6d75dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3580c5a-1a", "ovs_interfaceid": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Releasing lock "refresh_cache-f0a6ae6f-72f6-4357-8fe6-a327549d1918" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Instance network_info: |[{"id": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "address": "fa:16:3e:9f:1d:1b", "network": {"id": "9216f93e-0899-4614-afae-cb11f4ce634e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-955733189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8d419b234844da882073df16f6d75dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3580c5a-1a", "ovs_interfaceid": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fc93775e-9054-44bf-a0c2-acf595a03df3 req-4fde6679-99a5-42d8-a38f-c006bed40be6 service nova] Acquired lock "refresh_cache-f0a6ae6f-72f6-4357-8fe6-a327549d1918" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.network.neutron [req-fc93775e-9054-44bf-a0c2-acf595a03df3 req-4fde6679-99a5-42d8-a38f-c006bed40be6 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Refreshing network info cache for port d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Start _get_guest_xml network_info=[{"id": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "address": "fa:16:3e:9f:1d:1b", "network": {"id": "9216f93e-0899-4614-afae-cb11f4ce634e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-955733189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8d419b234844da882073df16f6d75dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3580c5a-1a", "ovs_interfaceid": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:53:48 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:48 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1630376416',display_name='tempest-VolumesActionsTest-instance-1630376416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1630376416',id=20,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8d419b234844da882073df16f6d75dc',ramdisk_id='',reservation_id='r-gejbolhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1878791940',owner_user_name='tempest-VolumesActionsTest-1878791940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:47Z,user_data=None,user_id='87500058da4343af8a40e9ecb0045745',uuid=f0a6ae6f-72f6-4357-8fe6-a327549d1918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "address": "fa:16:3e:9f:1d:1b", "network": {"id": "9216f93e-0899-4614-afae-cb11f4ce634e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-955733189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8d419b234844da882073df16f6d75dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3580c5a-1a", "ovs_interfaceid": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Converting VIF {"id": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "address": "fa:16:3e:9f:1d:1b", "network": {"id": "9216f93e-0899-4614-afae-cb11f4ce634e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-955733189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8d419b234844da882073df16f6d75dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3580c5a-1a", "ovs_interfaceid": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:1d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d3580c5a-1a9d-4342-8524-b95ba43e18b8,network=Network(9216f93e-0899-4614-afae-cb11f4ce634e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3580c5a-1a') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:48 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lazy-loading 'pci_devices' on Instance uuid f0a6ae6f-72f6-4357-8fe6-a327549d1918 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:53:49 user nova-compute[76161]:   <uuid>f0a6ae6f-72f6-4357-8fe6-a327549d1918</uuid>
Nov 14 17:53:49 user nova-compute[76161]:   <name>instance-00000014</name>
Nov 14 17:53:49 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:53:49 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:53:49 user nova-compute[76161]:   <metadata>
Nov 14 17:53:49 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:53:49 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:53:49 user nova-compute[76161]:       <nova:name>tempest-VolumesActionsTest-instance-1630376416</nova:name>
Nov 14 17:53:49 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:53:48</nova:creationTime>
Nov 14 17:53:49 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:53:49 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:53:49 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:53:49 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:53:49 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:53:49 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:53:49 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:53:49 user nova-compute[76161]:       <nova:owner>
Nov 14 17:53:49 user nova-compute[76161]:         <nova:user uuid="87500058da4343af8a40e9ecb0045745">tempest-VolumesActionsTest-1878791940-project-member</nova:user>
Nov 14 17:53:49 user nova-compute[76161]:         <nova:project uuid="f8d419b234844da882073df16f6d75dc">tempest-VolumesActionsTest-1878791940</nova:project>
Nov 14 17:53:49 user nova-compute[76161]:       </nova:owner>
Nov 14 17:53:49 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:53:49 user nova-compute[76161]:       <nova:ports>
Nov 14 17:53:49 user nova-compute[76161]:         <nova:port uuid="d3580c5a-1a9d-4342-8524-b95ba43e18b8">
Nov 14 17:53:49 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:53:49 user nova-compute[76161]:         </nova:port>
Nov 14 17:53:49 user nova-compute[76161]:       </nova:ports>
Nov 14 17:53:49 user nova-compute[76161]:     </nova:instance>
Nov 14 17:53:49 user nova-compute[76161]:   </metadata>
Nov 14 17:53:49 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:53:49 user nova-compute[76161]:     <system>
Nov 14 17:53:49 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:53:49 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:53:49 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:53:49 user nova-compute[76161]:       <entry name="serial">f0a6ae6f-72f6-4357-8fe6-a327549d1918</entry>
Nov 14 17:53:49 user nova-compute[76161]:       <entry name="uuid">f0a6ae6f-72f6-4357-8fe6-a327549d1918</entry>
Nov 14 17:53:49 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:53:49 user nova-compute[76161]:     </system>
Nov 14 17:53:49 user nova-compute[76161]:   </sysinfo>
Nov 14 17:53:49 user nova-compute[76161]:   <os>
Nov 14 17:53:49 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:53:49 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:53:49 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:53:49 user nova-compute[76161]:   </os>
Nov 14 17:53:49 user nova-compute[76161]:   <features>
Nov 14 17:53:49 user nova-compute[76161]:     <acpi/>
Nov 14 17:53:49 user nova-compute[76161]:     <apic/>
Nov 14 17:53:49 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:53:49 user nova-compute[76161]:   </features>
Nov 14 17:53:49 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:53:49 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:53:49 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:53:49 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:53:49 user nova-compute[76161]:   </clock>
Nov 14 17:53:49 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:53:49 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:53:49 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:53:49 user nova-compute[76161]:   </cpu>
Nov 14 17:53:49 user nova-compute[76161]:   <devices>
Nov 14 17:53:49 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:53:49 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:53:49 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk"/>
Nov 14 17:53:49 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:53:49 user nova-compute[76161]:     </disk>
Nov 14 17:53:49 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:53:49 user nova-compute[76161]:       <mac address="fa:16:3e:9f:1d:1b"/>
Nov 14 17:53:49 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:53:49 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:53:49 user nova-compute[76161]:       <target dev="tapd3580c5a-1a"/>
Nov 14 17:53:49 user nova-compute[76161]:     </interface>
Nov 14 17:53:49 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:53:49 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/console.log" append="off"/>
Nov 14 17:53:49 user nova-compute[76161]:     </serial>
Nov 14 17:53:49 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:53:49 user nova-compute[76161]:     <video>
Nov 14 17:53:49 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:53:49 user nova-compute[76161]:     </video>
Nov 14 17:53:49 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:53:49 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:53:49 user nova-compute[76161]:     </rng>
Nov 14 17:53:49 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:53:49 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:53:49 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:53:49 user nova-compute[76161]:     </memballoon>
Nov 14 17:53:49 user nova-compute[76161]:   </devices>
Nov 14 17:53:49 user nova-compute[76161]: </domain>
Nov 14 17:53:49 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1630376416',display_name='tempest-VolumesActionsTest-instance-1630376416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1630376416',id=20,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8d419b234844da882073df16f6d75dc',ramdisk_id='',reservation_id='r-gejbolhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1878791940',owner_user_name='tempest-VolumesActionsTest-1878791940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:53:47Z,user_data=None,user_id='87500058da4343af8a40e9ecb0045745',uuid=f0a6ae6f-72f6-4357-8fe6-a327549d1918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "address": "fa:16:3e:9f:1d:1b", "network": {"id": "9216f93e-0899-4614-afae-cb11f4ce634e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-955733189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8d419b234844da882073df16f6d75dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3580c5a-1a", "ovs_interfaceid": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Converting VIF {"id": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "address": "fa:16:3e:9f:1d:1b", "network": {"id": "9216f93e-0899-4614-afae-cb11f4ce634e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-955733189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8d419b234844da882073df16f6d75dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3580c5a-1a", "ovs_interfaceid": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:1d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d3580c5a-1a9d-4342-8524-b95ba43e18b8,network=Network(9216f93e-0899-4614-afae-cb11f4ce634e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3580c5a-1a') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG os_vif [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:1d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d3580c5a-1a9d-4342-8524-b95ba43e18b8,network=Network(9216f93e-0899-4614-afae-cb11f4ce634e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3580c5a-1a') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5650943f-6717-5bd4-b719-4ec4aada8509', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3580c5a-1a, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3580c5a-1a, col_values=(('qos', UUID('66b4b359-a8d3-4f0f-80b8-4aee31f380f6')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3580c5a-1a, col_values=(('external_ids', {'iface-id': 'd3580c5a-1a9d-4342-8524-b95ba43e18b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:1d:1b', 'vm-uuid': 'f0a6ae6f-72f6-4357-8fe6-a327549d1918'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:49 user nova-compute[76161]: INFO os_vif [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:1d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d3580c5a-1a9d-4342-8524-b95ba43e18b8,network=Network(9216f93e-0899-4614-afae-cb11f4ce634e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3580c5a-1a')
Nov 14 17:53:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] No VIF found with MAC fa:16:3e:9f:1d:1b, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG nova.network.neutron [req-fc93775e-9054-44bf-a0c2-acf595a03df3 req-4fde6679-99a5-42d8-a38f-c006bed40be6 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Updated VIF entry in instance network info cache for port d3580c5a-1a9d-4342-8524-b95ba43e18b8. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG nova.network.neutron [req-fc93775e-9054-44bf-a0c2-acf595a03df3 req-4fde6679-99a5-42d8-a38f-c006bed40be6 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Updating instance_info_cache with network_info: [{"id": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "address": "fa:16:3e:9f:1d:1b", "network": {"id": "9216f93e-0899-4614-afae-cb11f4ce634e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-955733189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8d419b234844da882073df16f6d75dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3580c5a-1a", "ovs_interfaceid": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fc93775e-9054-44bf-a0c2-acf595a03df3 req-4fde6679-99a5-42d8-a38f-c006bed40be6 service nova] Releasing lock "refresh_cache-f0a6ae6f-72f6-4357-8fe6-a327549d1918" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:53:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-d681d303-67c9-4de9-9ae9-ce200cdce55a req-c11b2799-7c35-4da1-9010-1f21af32ab0f service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received event network-vif-plugged-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d681d303-67c9-4de9-9ae9-ce200cdce55a req-c11b2799-7c35-4da1-9010-1f21af32ab0f service nova] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d681d303-67c9-4de9-9ae9-ce200cdce55a req-c11b2799-7c35-4da1-9010-1f21af32ab0f service nova] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d681d303-67c9-4de9-9ae9-ce200cdce55a req-c11b2799-7c35-4da1-9010-1f21af32ab0f service nova] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-d681d303-67c9-4de9-9ae9-ce200cdce55a req-c11b2799-7c35-4da1-9010-1f21af32ab0f service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] No waiting events found dispatching network-vif-plugged-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:50 user nova-compute[76161]: WARNING nova.compute.manager [req-d681d303-67c9-4de9-9ae9-ce200cdce55a req-c11b2799-7c35-4da1-9010-1f21af32ab0f service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received unexpected event network-vif-plugged-ea45b27f-34f8-4051-98f1-486c4f32d35a for instance with vm_state active and task_state None.
Nov 14 17:53:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-d49582b8-e375-484d-aac3-73a6ba71eef7 req-f5598743-63f1-493d-ab1e-1433f1ab94e3 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Received event network-vif-plugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d49582b8-e375-484d-aac3-73a6ba71eef7 req-f5598743-63f1-493d-ab1e-1433f1ab94e3 service nova] Acquiring lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d49582b8-e375-484d-aac3-73a6ba71eef7 req-f5598743-63f1-493d-ab1e-1433f1ab94e3 service nova] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d49582b8-e375-484d-aac3-73a6ba71eef7 req-f5598743-63f1-493d-ab1e-1433f1ab94e3 service nova] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-d49582b8-e375-484d-aac3-73a6ba71eef7 req-f5598743-63f1-493d-ab1e-1433f1ab94e3 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] No waiting events found dispatching network-vif-plugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:52 user nova-compute[76161]: WARNING nova.compute.manager [req-d49582b8-e375-484d-aac3-73a6ba71eef7 req-f5598743-63f1-493d-ab1e-1433f1ab94e3 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Received unexpected event network-vif-plugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 for instance with vm_state building and task_state spawning.
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:53:52 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Instance spawned successfully.
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:53:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:53 user nova-compute[76161]: INFO nova.compute.manager [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 14 17:53:53 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:53:53 user nova-compute[76161]: INFO nova.compute.manager [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Took 7.45 seconds to build instance.
Nov 14 17:53:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d3ebaf0-1edb-41cc-b97d-f38a976ab23a tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.631s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-5a87765d-d941-40c2-b919-08f2f4bb1810 req-05b3ce44-a497-4c25-b590-b56677102d46 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Received event network-vif-plugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:53:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5a87765d-d941-40c2-b919-08f2f4bb1810 req-05b3ce44-a497-4c25-b590-b56677102d46 service nova] Acquiring lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:53:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5a87765d-d941-40c2-b919-08f2f4bb1810 req-05b3ce44-a497-4c25-b590-b56677102d46 service nova] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:53:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5a87765d-d941-40c2-b919-08f2f4bb1810 req-05b3ce44-a497-4c25-b590-b56677102d46 service nova] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:53:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-5a87765d-d941-40c2-b919-08f2f4bb1810 req-05b3ce44-a497-4c25-b590-b56677102d46 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] No waiting events found dispatching network-vif-plugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:53:54 user nova-compute[76161]: WARNING nova.compute.manager [req-5a87765d-d941-40c2-b919-08f2f4bb1810 req-05b3ce44-a497-4c25-b590-b56677102d46 service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Received unexpected event network-vif-plugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 for instance with vm_state active and task_state None.
Nov 14 17:53:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:53:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:04 user nova-compute[76161]: INFO nova.compute.manager [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Rescuing
Nov 14 17:54:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:54:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquired lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:54:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:54:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updating instance_info_cache with network_info: [{"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Releasing lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:54:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-3a61e0df-b2ca-4bc6-99af-67793b5d26b9 req-5d0a74df-8037-48cb-a619-afe7fa64c61f service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-unplugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3a61e0df-b2ca-4bc6-99af-67793b5d26b9 req-5d0a74df-8037-48cb-a619-afe7fa64c61f service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3a61e0df-b2ca-4bc6-99af-67793b5d26b9 req-5d0a74df-8037-48cb-a619-afe7fa64c61f service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3a61e0df-b2ca-4bc6-99af-67793b5d26b9 req-5d0a74df-8037-48cb-a619-afe7fa64c61f service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-3a61e0df-b2ca-4bc6-99af-67793b5d26b9 req-5d0a74df-8037-48cb-a619-afe7fa64c61f service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-unplugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:54:06 user nova-compute[76161]: WARNING nova.compute.manager [req-3a61e0df-b2ca-4bc6-99af-67793b5d26b9 req-5d0a74df-8037-48cb-a619-afe7fa64c61f service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-unplugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state active and task_state rescuing.
Nov 14 17:54:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:54:06 user nova-compute[76161]: INFO nova.compute.claims [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Claim successful on node user
Nov 14 17:54:06 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Instance destroyed successfully.
Nov 14 17:54:06 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Attempting a stable device rescue
Nov 14 17:54:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76161) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Instance directory exists: not creating {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 17:54:06 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Creating image(s)
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "/opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "/opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG nova.objects.instance [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce.part --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce.part --force-share --output=json" returned: 0 in 0.241s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG nova.virt.images [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] c7fda17f-d83d-4893-8a91-80dc1a930374 was qcow2, converting to raw {{(pid=76161) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce.part /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce.converted {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-544de6cf-8c56-4e87-9495-d1f51f635203 req-f755dcd8-d800-4aad-9455-6f34757825b6 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-544de6cf-8c56-4e87-9495-d1f51f635203 req-f755dcd8-d800-4aad-9455-6f34757825b6 service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-544de6cf-8c56-4e87-9495-d1f51f635203 req-f755dcd8-d800-4aad-9455-6f34757825b6 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-544de6cf-8c56-4e87-9495-d1f51f635203 req-f755dcd8-d800-4aad-9455-6f34757825b6 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-544de6cf-8c56-4e87-9495-d1f51f635203 req-f755dcd8-d800-4aad-9455-6f34757825b6 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:54:08 user nova-compute[76161]: WARNING nova.compute.manager [req-544de6cf-8c56-4e87-9495-d1f51f635203 req-f755dcd8-d800-4aad-9455-6f34757825b6 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state active and task_state rescuing.
Nov 14 17:54:08 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.455s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG nova.network.neutron [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce.part /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce.converted" returned: 0 in 0.739s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce.converted --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:08 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:54:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.policy [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d894650d77b475e9894d1e55cf3a153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6afde13e69f4185b045ae4f93063363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.572s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:54:09 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Creating image(s)
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "/opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "/opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce --force-share --output=json" returned: 0 in 0.190s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce,backing_fmt=raw /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce,backing_fmt=raw /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue" returned: 0 in 0.079s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.objects.instance [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'migration_context' on Instance uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.objects.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Object Instance<e6b27e32-d956-4f41-b278-d7d088c7edbc> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Start _get_guest_xml network_info=[{"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "vif_mac": "fa:16:3e:96:f2:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c7fda17f-d83d-4893-8a91-80dc1a930374', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptJSETF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e6b27e32-d956-4f41-b278-d7d088c7edbc', 'attached_at': '', 'detached_at': '', 'volume_id': '5146bbb8-274b-49d7-864b-1333d8f9479c', 'serial': '5146bbb8-274b-49d7-864b-1333d8f9479c'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'bc13e7bd-7e2f-497d-92c5-acc1a6a8c832', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.objects.instance [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'resources' on Instance uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.objects.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Object Instance<e6b27e32-d956-4f41-b278-d7d088c7edbc> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.objects.instance [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'numa_topology' on Instance uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.objects.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Object Instance<e6b27e32-d956-4f41-b278-d7d088c7edbc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 17:54:09 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:54:09 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.objects.instance [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.objects.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Object Instance<e6b27e32-d956-4f41-b278-d7d088c7edbc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptJSETF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:54:09 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:54:09 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:54:09 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[159f5f3b-595b-4826-a396-dd47343232ef]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = eptJSETF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 17:54:09 user nova-compute[76161]: node.name = iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:54:09 user nova-compute[76161]: node.tpgt = -1
Nov 14 17:54:09 user nova-compute[76161]: node.startup = automatic
Nov 14 17:54:09 user nova-compute[76161]: node.leading_login = No
Nov 14 17:54:09 user nova-compute[76161]: iface.iscsi_ifacename = default
Nov 14 17:54:09 user nova-compute[76161]: iface.net_ifacename = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.ipaddress = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.prefix_len = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.hwaddress = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.transport_name = tcp
Nov 14 17:54:09 user nova-compute[76161]: iface.initiatorname = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.state = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.vlan_id = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.vlan_priority = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.vlan_state = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.iface_num = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.mtu = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.port = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.bootproto = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.subnet_mask = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.gateway = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.dhcp_alt_client_id = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.dhcp_dns = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.dhcp_learn_iqn = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.dhcp_vendor_id_state = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.dhcp_vendor_id = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.dhcp_slp_da = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.fragmentation = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.gratuitous_arp = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.incoming_forwarding = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.tos_state = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.tos = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.ttl = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.delayed_ack = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.tcp_nagle = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.tcp_wsf_state = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.tcp_wsf = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.tcp_timer_scale = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.tcp_timestamp = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.redirect = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.def_task_mgmt_timeout = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.header_digest = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.data_digest = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.immediate_data = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.initial_r2t = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.data_seq_inorder = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.data_pdu_inorder = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.erl = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.max_receive_data_len = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.first_burst_len = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.max_outstanding_r2t = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.max_burst_len = 0
Nov 14 17:54:09 user nova-compute[76161]: iface.chap_auth = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.bidi_chap = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.strict_login_compliance = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.discovery_auth = <empty>
Nov 14 17:54:09 user nova-compute[76161]: iface.discovery_logout = <empty>
Nov 14 17:54:09 user nova-compute[76161]: node.discovery_address = <empty>
Nov 14 17:54:09 user nova-compute[76161]: node.discovery_port = 0
Nov 14 17:54:09 user nova-compute[76161]: node.discovery_type = static
Nov 14 17:54:09 user nova-compute[76161]: node.session.initial_cmdsn = 0
Nov 14 17:54:09 user nova-compute[76161]: node.session.initial_login_retry_max = 8
Nov 14 17:54:09 user nova-compute[76161]: node.session.xmit_thread_priority = -20
Nov 14 17:54:09 user nova-compute[76161]: node.session.cmds_max = 128
Nov 14 17:54:09 user nova-compute[76161]: node.session.queue_depth = 32
Nov 14 17:54:09 user nova-compute[76161]: node.session.nr_sessions = 1
Nov 14 17:54:09 user nova-compute[76161]: node.session.auth.authmethod = CHAP
Nov 14 17:54:09 user nova-compute[76161]: node.session.auth.username = eptJSETF
Nov 14 17:54:09 user nova-compute[76161]: node.session.auth.password = ***
Nov 14 17:54:09 user nova-compute[76161]: node.session.auth.username_in = <empty>
Nov 14 17:54:09 user nova-compute[76161]: node.session.auth.password_in = <empty>
Nov 14 17:54:09 user nova-compute[76161]: node.session.auth.chap_algs = MD5
Nov 14 17:54:09 user nova-compute[76161]: node.session.timeo.replacement_timeout = 120
Nov 14 17:54:09 user nova-compute[76161]: node.session.err_timeo.abort_timeout = 15
Nov 14 17:54:09 user nova-compute[76161]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 17:54:09 user nova-compute[76161]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 17:54:09 user nova-compute[76161]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 17:54:09 user nova-compute[76161]: node.session.iscsi.FastAbort = Yes
Nov 14 17:54:09 user nova-compute[76161]: node.session.iscsi.InitialR2T = No
Nov 14 17:54:09 user nova-compute[76161]: node.session.iscsi.ImmediateData = Yes
Nov 14 17:54:09 user nova-compute[76161]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 17:54:09 user nova-compute[76161]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 17:54:09 user nova-compute[76161]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 17:54:09 user nova-compute[76161]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 17:54:09 user nova-compute[76161]: node.session.iscsi.MaxConnections = 1
Nov 14 17:54:09 user nova-compute[76161]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 17:54:09 user nova-compute[76161]: node.session.iscsi.ERL = 0
Nov 14 17:54:09 user nova-compute[76161]: node.session.scan = manual
Nov 14 17:54:09 user nova-compute[76161]: node.session.reopen_max = 0
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].address = 172.16.0.220
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].port = 3260
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].startup = manual
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].tcp.window_size = 524288
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].tcp.type_of_service = 0
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].timeo.logout_timeout = 15
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].timeo.login_timeout = 15
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].timeo.auth_timeout = 45
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].iscsi.DataDigest = None
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].iscsi.IFMarker = No
Nov 14 17:54:09 user nova-compute[76161]: node.conn[0].iscsi.OFMarker = No
Nov 14 17:54:09 user nova-compute[76161]: # END RECORD
Nov 14 17:54:09 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk 1073741824" returned: 0 in 0.048s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3232fccb-48d8-465e-8c46-f7578c377b6a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8d55cb-da45-451b-8212-12a35720100d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eptJSETF {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eptJSETF" returned: 0 in 0.042s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f59e752-3ea1-405e-ba60-a8ab6cf155c2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eptJSETF'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc397975-060b-46cf-a40c-23dbe27aaf48]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Successfully created port: 6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[72479958-7ee4-4a73-975e-c9fb77e2c55b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:54:09 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:54:09 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:54:09 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:54:09 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] HCTL ('35', '0', '0', 0) found on session 16 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.192s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fea257e-706b-44ba-8fda-75b76b16ebfd]: (4, ('0 0 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching for a device in session 16 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptJSETF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.298s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] <== connect_volume: return (301ms) {'type': 'block', 'scsi_wwn': '23736336232643963', 'path': '/dev/sdd'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736336232643963', 'path': '/dev/sdd'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1186448522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1186448522',id=14,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-c0ltbv0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:52:33Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=e6b27e32-d956-4f41-b278-d7d088c7edbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "vif_mac": "fa:16:3e:96:f2:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "vif_mac": "fa:16:3e:96:f2:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=420627a0-11f4-43cc-b08c-84739104b43c,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420627a0-11') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.objects.instance [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'pci_devices' on Instance uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.objects.base [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Object Instance<e6b27e32-d956-4f41-b278-d7d088c7edbc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:54:09 user nova-compute[76161]:   <uuid>e6b27e32-d956-4f41-b278-d7d088c7edbc</uuid>
Nov 14 17:54:09 user nova-compute[76161]:   <name>instance-0000000e</name>
Nov 14 17:54:09 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:54:09 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:54:09 user nova-compute[76161]:   <metadata>
Nov 14 17:54:09 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:54:09 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:54:09 user nova-compute[76161]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1186448522</nova:name>
Nov 14 17:54:09 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:54:09</nova:creationTime>
Nov 14 17:54:09 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:54:09 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:54:09 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:54:09 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:54:09 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:54:09 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:54:09 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:54:09 user nova-compute[76161]:       <nova:owner>
Nov 14 17:54:09 user nova-compute[76161]:         <nova:user uuid="4714975d06d8455788463a30e9bc5faa">tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member</nova:user>
Nov 14 17:54:09 user nova-compute[76161]:         <nova:project uuid="69696059b86f44b7ae274bf8274f9843">tempest-ServerBootFromVolumeStableRescueTest-500586355</nova:project>
Nov 14 17:54:09 user nova-compute[76161]:       </nova:owner>
Nov 14 17:54:09 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:54:09 user nova-compute[76161]:       <nova:ports>
Nov 14 17:54:09 user nova-compute[76161]:         <nova:port uuid="420627a0-11f4-43cc-b08c-84739104b43c">
Nov 14 17:54:09 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 17:54:09 user nova-compute[76161]:         </nova:port>
Nov 14 17:54:09 user nova-compute[76161]:       </nova:ports>
Nov 14 17:54:09 user nova-compute[76161]:     </nova:instance>
Nov 14 17:54:09 user nova-compute[76161]:   </metadata>
Nov 14 17:54:09 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:54:09 user nova-compute[76161]:     <system>
Nov 14 17:54:09 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:54:09 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:54:09 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:54:09 user nova-compute[76161]:       <entry name="serial">e6b27e32-d956-4f41-b278-d7d088c7edbc</entry>
Nov 14 17:54:09 user nova-compute[76161]:       <entry name="uuid">e6b27e32-d956-4f41-b278-d7d088c7edbc</entry>
Nov 14 17:54:09 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:54:09 user nova-compute[76161]:     </system>
Nov 14 17:54:09 user nova-compute[76161]:   </sysinfo>
Nov 14 17:54:09 user nova-compute[76161]:   <os>
Nov 14 17:54:09 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:54:09 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:54:09 user nova-compute[76161]:   </os>
Nov 14 17:54:09 user nova-compute[76161]:   <features>
Nov 14 17:54:09 user nova-compute[76161]:     <acpi/>
Nov 14 17:54:09 user nova-compute[76161]:     <apic/>
Nov 14 17:54:09 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:54:09 user nova-compute[76161]:   </features>
Nov 14 17:54:09 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:54:09 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:54:09 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:54:09 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:54:09 user nova-compute[76161]:   </clock>
Nov 14 17:54:09 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:54:09 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:54:09 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:54:09 user nova-compute[76161]:   </cpu>
Nov 14 17:54:09 user nova-compute[76161]:   <devices>
Nov 14 17:54:09 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:54:09 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:54:09 user nova-compute[76161]:       <source dev="/dev/sdd"/>
Nov 14 17:54:09 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:54:09 user nova-compute[76161]:       <serial>5146bbb8-274b-49d7-864b-1333d8f9479c</serial>
Nov 14 17:54:09 user nova-compute[76161]:     </disk>
Nov 14 17:54:09 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:54:09 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:54:09 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue"/>
Nov 14 17:54:09 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 17:54:09 user nova-compute[76161]:       <boot order="1"/>
Nov 14 17:54:09 user nova-compute[76161]:     </disk>
Nov 14 17:54:09 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:54:09 user nova-compute[76161]:       <mac address="fa:16:3e:96:f2:43"/>
Nov 14 17:54:09 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:54:09 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:54:09 user nova-compute[76161]:       <target dev="tap420627a0-11"/>
Nov 14 17:54:09 user nova-compute[76161]:     </interface>
Nov 14 17:54:09 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:54:09 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/console.log" append="off"/>
Nov 14 17:54:09 user nova-compute[76161]:     </serial>
Nov 14 17:54:09 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:54:09 user nova-compute[76161]:     <video>
Nov 14 17:54:09 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:54:09 user nova-compute[76161]:     </video>
Nov 14 17:54:09 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:54:09 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:54:09 user nova-compute[76161]:     </rng>
Nov 14 17:54:09 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:54:09 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:54:09 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:54:09 user nova-compute[76161]:     </memballoon>
Nov 14 17:54:09 user nova-compute[76161]:   </devices>
Nov 14 17:54:09 user nova-compute[76161]: </domain>
Nov 14 17:54:09 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:09 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Instance destroyed successfully.
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Cannot resize image /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Ensure instance console log exists: /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No VIF found with MAC fa:16:3e:96:f2:43, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.network.neutron [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Successfully updated port: 6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "refresh_cache-fdcdc21a-3601-4f26-8da3-f345c35d839d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquired lock "refresh_cache-fdcdc21a-3601-4f26-8da3-f345c35d839d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.network.neutron [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-2a094450-02db-421f-a252-b7a01a5239c9 req-db3a52ff-5804-4f61-ae5e-02e24d66762b service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received event network-changed-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-2a094450-02db-421f-a252-b7a01a5239c9 req-db3a52ff-5804-4f61-ae5e-02e24d66762b service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Refreshing instance network info cache due to event network-changed-6c769206-c0b4-4709-bea6-76a2cc640a57. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2a094450-02db-421f-a252-b7a01a5239c9 req-db3a52ff-5804-4f61-ae5e-02e24d66762b service nova] Acquiring lock "refresh_cache-fdcdc21a-3601-4f26-8da3-f345c35d839d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.network.neutron [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.network.neutron [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Updating instance_info_cache with network_info: [{"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Releasing lock "refresh_cache-fdcdc21a-3601-4f26-8da3-f345c35d839d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Instance network_info: |[{"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2a094450-02db-421f-a252-b7a01a5239c9 req-db3a52ff-5804-4f61-ae5e-02e24d66762b service nova] Acquired lock "refresh_cache-fdcdc21a-3601-4f26-8da3-f345c35d839d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.network.neutron [req-2a094450-02db-421f-a252-b7a01a5239c9 req-db3a52ff-5804-4f61-ae5e-02e24d66762b service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Refreshing network info cache for port 6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Start _get_guest_xml network_info=[{"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:54:10 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:54:10 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1407322857',display_name='tempest-TestVolumeSwap-server-1407322857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1407322857',id=21,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4YOBCjMVd+vpJJHziZCKYEq7lKymcYS1ILvo9TvK0nCx3LnHRLd6ZqrFetTGl2Eouc0TqPNswi2gOehvE2va54Ec0AkFIYSyTN0nHeaT1EBH3czAjUrKXihAd4anWIA==',key_name='tempest-keypair-1162978824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6afde13e69f4185b045ae4f93063363',ramdisk_id='',reservation_id='r-quf60n98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2114207770',owner_user_name='tempest-TestVolumeSwap-2114207770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d894650d77b475e9894d1e55cf3a153',uuid=fdcdc21a-3601-4f26-8da3-f345c35d839d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Converting VIF {"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=6c769206-c0b4-4709-bea6-76a2cc640a57,network=Network(808f1145-de86-4e68-b23a-ab33ba6cf807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c769206-c0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lazy-loading 'pci_devices' on Instance uuid fdcdc21a-3601-4f26-8da3-f345c35d839d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:54:10 user nova-compute[76161]:   <uuid>fdcdc21a-3601-4f26-8da3-f345c35d839d</uuid>
Nov 14 17:54:10 user nova-compute[76161]:   <name>instance-00000015</name>
Nov 14 17:54:10 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:54:10 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:54:10 user nova-compute[76161]:   <metadata>
Nov 14 17:54:10 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:54:10 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:54:10 user nova-compute[76161]:       <nova:name>tempest-TestVolumeSwap-server-1407322857</nova:name>
Nov 14 17:54:10 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:54:10</nova:creationTime>
Nov 14 17:54:10 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:54:10 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:54:10 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:54:10 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:54:10 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:54:10 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:54:10 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:54:10 user nova-compute[76161]:       <nova:owner>
Nov 14 17:54:10 user nova-compute[76161]:         <nova:user uuid="4d894650d77b475e9894d1e55cf3a153">tempest-TestVolumeSwap-2114207770-project-member</nova:user>
Nov 14 17:54:10 user nova-compute[76161]:         <nova:project uuid="a6afde13e69f4185b045ae4f93063363">tempest-TestVolumeSwap-2114207770</nova:project>
Nov 14 17:54:10 user nova-compute[76161]:       </nova:owner>
Nov 14 17:54:10 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:54:10 user nova-compute[76161]:       <nova:ports>
Nov 14 17:54:10 user nova-compute[76161]:         <nova:port uuid="6c769206-c0b4-4709-bea6-76a2cc640a57">
Nov 14 17:54:10 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 17:54:10 user nova-compute[76161]:         </nova:port>
Nov 14 17:54:10 user nova-compute[76161]:       </nova:ports>
Nov 14 17:54:10 user nova-compute[76161]:     </nova:instance>
Nov 14 17:54:10 user nova-compute[76161]:   </metadata>
Nov 14 17:54:10 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:54:10 user nova-compute[76161]:     <system>
Nov 14 17:54:10 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:54:10 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:54:10 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:54:10 user nova-compute[76161]:       <entry name="serial">fdcdc21a-3601-4f26-8da3-f345c35d839d</entry>
Nov 14 17:54:10 user nova-compute[76161]:       <entry name="uuid">fdcdc21a-3601-4f26-8da3-f345c35d839d</entry>
Nov 14 17:54:10 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:54:10 user nova-compute[76161]:     </system>
Nov 14 17:54:10 user nova-compute[76161]:   </sysinfo>
Nov 14 17:54:10 user nova-compute[76161]:   <os>
Nov 14 17:54:10 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:54:10 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:54:10 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:54:10 user nova-compute[76161]:   </os>
Nov 14 17:54:10 user nova-compute[76161]:   <features>
Nov 14 17:54:10 user nova-compute[76161]:     <acpi/>
Nov 14 17:54:10 user nova-compute[76161]:     <apic/>
Nov 14 17:54:10 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:54:10 user nova-compute[76161]:   </features>
Nov 14 17:54:10 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:54:10 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:54:10 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:54:10 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:54:10 user nova-compute[76161]:   </clock>
Nov 14 17:54:10 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:54:10 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:54:10 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:54:10 user nova-compute[76161]:   </cpu>
Nov 14 17:54:10 user nova-compute[76161]:   <devices>
Nov 14 17:54:10 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:54:10 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:54:10 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk"/>
Nov 14 17:54:10 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:54:10 user nova-compute[76161]:     </disk>
Nov 14 17:54:10 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:54:10 user nova-compute[76161]:       <mac address="fa:16:3e:ef:c5:37"/>
Nov 14 17:54:10 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:54:10 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:54:10 user nova-compute[76161]:       <target dev="tap6c769206-c0"/>
Nov 14 17:54:10 user nova-compute[76161]:     </interface>
Nov 14 17:54:10 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:54:10 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/console.log" append="off"/>
Nov 14 17:54:10 user nova-compute[76161]:     </serial>
Nov 14 17:54:10 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:54:10 user nova-compute[76161]:     <video>
Nov 14 17:54:10 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:54:10 user nova-compute[76161]:     </video>
Nov 14 17:54:10 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:54:10 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:54:10 user nova-compute[76161]:     </rng>
Nov 14 17:54:10 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:54:10 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:54:10 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:54:10 user nova-compute[76161]:     </memballoon>
Nov 14 17:54:10 user nova-compute[76161]:   </devices>
Nov 14 17:54:10 user nova-compute[76161]: </domain>
Nov 14 17:54:10 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1407322857',display_name='tempest-TestVolumeSwap-server-1407322857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1407322857',id=21,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4YOBCjMVd+vpJJHziZCKYEq7lKymcYS1ILvo9TvK0nCx3LnHRLd6ZqrFetTGl2Eouc0TqPNswi2gOehvE2va54Ec0AkFIYSyTN0nHeaT1EBH3czAjUrKXihAd4anWIA==',key_name='tempest-keypair-1162978824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6afde13e69f4185b045ae4f93063363',ramdisk_id='',reservation_id='r-quf60n98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2114207770',owner_user_name='tempest-TestVolumeSwap-2114207770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d894650d77b475e9894d1e55cf3a153',uuid=fdcdc21a-3601-4f26-8da3-f345c35d839d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Converting VIF {"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=6c769206-c0b4-4709-bea6-76a2cc640a57,network=Network(808f1145-de86-4e68-b23a-ab33ba6cf807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c769206-c0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG os_vif [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=6c769206-c0b4-4709-bea6-76a2cc640a57,network=Network(808f1145-de86-4e68-b23a-ab33ba6cf807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c769206-c0') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1677ecee-84e0-5a6b-ab9f-bdd38b8d755c', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c769206-c0, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c769206-c0, col_values=(('qos', UUID('0ee8e375-45c1-4031-acae-36da8ce2da45')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c769206-c0, col_values=(('external_ids', {'iface-id': '6c769206-c0b4-4709-bea6-76a2cc640a57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:c5:37', 'vm-uuid': 'fdcdc21a-3601-4f26-8da3-f345c35d839d'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:54:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:10 user nova-compute[76161]: INFO os_vif [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=6c769206-c0b4-4709-bea6-76a2cc640a57,network=Network(808f1145-de86-4e68-b23a-ab33ba6cf807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c769206-c0')
Nov 14 17:54:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:54:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] No VIF found with MAC fa:16:3e:ef:c5:37, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:54:11 user nova-compute[76161]: DEBUG nova.network.neutron [req-2a094450-02db-421f-a252-b7a01a5239c9 req-db3a52ff-5804-4f61-ae5e-02e24d66762b service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Updated VIF entry in instance network info cache for port 6c769206-c0b4-4709-bea6-76a2cc640a57. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:54:11 user nova-compute[76161]: DEBUG nova.network.neutron [req-2a094450-02db-421f-a252-b7a01a5239c9 req-db3a52ff-5804-4f61-ae5e-02e24d66762b service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Updating instance_info_cache with network_info: [{"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2a094450-02db-421f-a252-b7a01a5239c9 req-db3a52ff-5804-4f61-ae5e-02e24d66762b service nova] Releasing lock "refresh_cache-fdcdc21a-3601-4f26-8da3-f345c35d839d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:54:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-b3e55bdb-ef4f-4946-87e7-28a5e5cc3bd2 req-c78537ed-470f-4cc5-a8a8-2ae82e16a56b service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b3e55bdb-ef4f-4946-87e7-28a5e5cc3bd2 req-c78537ed-470f-4cc5-a8a8-2ae82e16a56b service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b3e55bdb-ef4f-4946-87e7-28a5e5cc3bd2 req-c78537ed-470f-4cc5-a8a8-2ae82e16a56b service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b3e55bdb-ef4f-4946-87e7-28a5e5cc3bd2 req-c78537ed-470f-4cc5-a8a8-2ae82e16a56b service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-b3e55bdb-ef4f-4946-87e7-28a5e5cc3bd2 req-c78537ed-470f-4cc5-a8a8-2ae82e16a56b service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:54:12 user nova-compute[76161]: WARNING nova.compute.manager [req-b3e55bdb-ef4f-4946-87e7-28a5e5cc3bd2 req-c78537ed-470f-4cc5-a8a8-2ae82e16a56b service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state active and task_state rescuing.
Nov 14 17:54:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-2f74d53d-5a55-439e-a4c2-47703cff133f req-c834cbcb-8823-489e-824a-cbf378f1a092 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received event network-vif-plugged-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2f74d53d-5a55-439e-a4c2-47703cff133f req-c834cbcb-8823-489e-824a-cbf378f1a092 service nova] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2f74d53d-5a55-439e-a4c2-47703cff133f req-c834cbcb-8823-489e-824a-cbf378f1a092 service nova] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2f74d53d-5a55-439e-a4c2-47703cff133f req-c834cbcb-8823-489e-824a-cbf378f1a092 service nova] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-2f74d53d-5a55-439e-a4c2-47703cff133f req-c834cbcb-8823-489e-824a-cbf378f1a092 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] No waiting events found dispatching network-vif-plugged-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:54:13 user nova-compute[76161]: WARNING nova.compute.manager [req-2f74d53d-5a55-439e-a4c2-47703cff133f req-c834cbcb-8823-489e-824a-cbf378f1a092 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received unexpected event network-vif-plugged-6c769206-c0b4-4709-bea6-76a2cc640a57 for instance with vm_state building and task_state spawning.
Nov 14 17:54:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-2ee6fd0c-b9b5-4e05-8d88-fe6ddeeb295e req-791f9ffe-a8e6-4371-ad19-013e9f46d69f service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2ee6fd0c-b9b5-4e05-8d88-fe6ddeeb295e req-791f9ffe-a8e6-4371-ad19-013e9f46d69f service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2ee6fd0c-b9b5-4e05-8d88-fe6ddeeb295e req-791f9ffe-a8e6-4371-ad19-013e9f46d69f service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2ee6fd0c-b9b5-4e05-8d88-fe6ddeeb295e req-791f9ffe-a8e6-4371-ad19-013e9f46d69f service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-2ee6fd0c-b9b5-4e05-8d88-fe6ddeeb295e req-791f9ffe-a8e6-4371-ad19-013e9f46d69f service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:54:14 user nova-compute[76161]: WARNING nova.compute.manager [req-2ee6fd0c-b9b5-4e05-8d88-fe6ddeeb295e req-791f9ffe-a8e6-4371-ad19-013e9f46d69f service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state active and task_state rescuing.
Nov 14 17:54:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4219d455-04f7-4862-80e3-38630ea6162a tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-5cb3f056-c89d-4f8e-936f-905b3cb407b2 req-9d246415-7612-43e8-b413-df7d67a62250 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received event network-vif-plugged-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5cb3f056-c89d-4f8e-936f-905b3cb407b2 req-9d246415-7612-43e8-b413-df7d67a62250 service nova] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5cb3f056-c89d-4f8e-936f-905b3cb407b2 req-9d246415-7612-43e8-b413-df7d67a62250 service nova] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5cb3f056-c89d-4f8e-936f-905b3cb407b2 req-9d246415-7612-43e8-b413-df7d67a62250 service nova] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-5cb3f056-c89d-4f8e-936f-905b3cb407b2 req-9d246415-7612-43e8-b413-df7d67a62250 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] No waiting events found dispatching network-vif-plugged-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:54:15 user nova-compute[76161]: WARNING nova.compute.manager [req-5cb3f056-c89d-4f8e-936f-905b3cb407b2 req-9d246415-7612-43e8-b413-df7d67a62250 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received unexpected event network-vif-plugged-6c769206-c0b4-4709-bea6-76a2cc640a57 for instance with vm_state building and task_state spawning.
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:54:15 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Instance spawned successfully.
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:54:15 user nova-compute[76161]: INFO nova.compute.manager [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:54:15 user nova-compute[76161]: INFO nova.compute.manager [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Took 9.50 seconds to build instance.
Nov 14 17:54:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a5ea7091-c868-4ed3-8ced-b4f08cb6c3a1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.624s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:54:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Updating instance_info_cache with network_info: [{"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-678e458a-aeb6-4f29-b20b-74115179025f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "8b08db54-6a49-41fa-a188-d41593d91cb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:19 user nova-compute[76161]: INFO nova.compute.manager [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Terminating instance
Nov 14 17:54:19 user nova-compute[76161]: DEBUG nova.compute.manager [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-0e678e9f-0d92-4703-af55-5f3c534c7392 req-654c00f7-998f-4cf6-bef2-fd9ebb3e5d61 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Received event network-vif-unplugged-a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e678e9f-0d92-4703-af55-5f3c534c7392 req-654c00f7-998f-4cf6-bef2-fd9ebb3e5d61 service nova] Acquiring lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e678e9f-0d92-4703-af55-5f3c534c7392 req-654c00f7-998f-4cf6-bef2-fd9ebb3e5d61 service nova] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0e678e9f-0d92-4703-af55-5f3c534c7392 req-654c00f7-998f-4cf6-bef2-fd9ebb3e5d61 service nova] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-0e678e9f-0d92-4703-af55-5f3c534c7392 req-654c00f7-998f-4cf6-bef2-fd9ebb3e5d61 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] No waiting events found dispatching network-vif-unplugged-a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-0e678e9f-0d92-4703-af55-5f3c534c7392 req-654c00f7-998f-4cf6-bef2-fd9ebb3e5d61 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Received event network-vif-unplugged-a193ca5a-05d4-414e-a041-ec300eee1a08 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:19 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Instance destroyed successfully.
Nov 14 17:54:19 user nova-compute[76161]: DEBUG nova.objects.instance [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lazy-loading 'resources' on Instance uuid 8b08db54-6a49-41fa-a188-d41593d91cb9 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-213243073',display_name='tempest-VolumesAdminNegativeTest-server-213243073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-213243073',id=15,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:52:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c734a545ba17409c812203610ba23ab9',ramdisk_id='',reservation_id='r-tsqbvyq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-826340027',owner_user_name='tempest-VolumesAdminNegativeTest-826340027-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:52:33Z,user_data=None,user_id='ce9768ac5fdb4774874128973d9e7b35',uuid=8b08db54-6a49-41fa-a188-d41593d91cb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a193ca5a-05d4-414e-a041-ec300eee1a08", "address": "fa:16:3e:e2:0b:2c", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa193ca5a-05", "ovs_interfaceid": "a193ca5a-05d4-414e-a041-ec300eee1a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converting VIF {"id": "a193ca5a-05d4-414e-a041-ec300eee1a08", "address": "fa:16:3e:e2:0b:2c", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa193ca5a-05", "ovs_interfaceid": "a193ca5a-05d4-414e-a041-ec300eee1a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:2c,bridge_name='br-int',has_traffic_filtering=True,id=a193ca5a-05d4-414e-a041-ec300eee1a08,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa193ca5a-05') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG os_vif [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:2c,bridge_name='br-int',has_traffic_filtering=True,id=a193ca5a-05d4-414e-a041-ec300eee1a08,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa193ca5a-05') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa193ca5a-05, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2806cb1-40ad-42f6-89ab-c0a423976b71) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:54:19 user nova-compute[76161]: INFO os_vif [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:2c,bridge_name='br-int',has_traffic_filtering=True,id=a193ca5a-05d4-414e-a041-ec300eee1a08,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa193ca5a-05')
Nov 14 17:54:19 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Deleting instance files /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9_del
Nov 14 17:54:19 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Deletion of /opt/stack/data/nova/instances/8b08db54-6a49-41fa-a188-d41593d91cb9_del complete
Nov 14 17:54:20 user nova-compute[76161]: INFO nova.compute.manager [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-2c6873d6-a565-4538-9110-f43dff0243b4 req-19c0fe29-8042-4cc8-9e86-4c17775098f6 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Received event network-vif-deleted-a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:20 user nova-compute[76161]: INFO nova.compute.manager [req-2c6873d6-a565-4538-9110-f43dff0243b4 req-19c0fe29-8042-4cc8-9e86-4c17775098f6 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Neutron deleted interface a193ca5a-05d4-414e-a041-ec300eee1a08; detaching it from the instance and deleting it from the info cache
Nov 14 17:54:20 user nova-compute[76161]: DEBUG nova.network.neutron [req-2c6873d6-a565-4538-9110-f43dff0243b4 req-19c0fe29-8042-4cc8-9e86-4c17775098f6 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:20 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Took 0.56 seconds to deallocate network for instance.
Nov 14 17:54:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-2c6873d6-a565-4538-9110-f43dff0243b4 req-19c0fe29-8042-4cc8-9e86-4c17775098f6 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Detach interface failed, port_id=a193ca5a-05d4-414e-a041-ec300eee1a08, reason: Instance 8b08db54-6a49-41fa-a188-d41593d91cb9 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:21 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Deleted allocations for instance 8b08db54-6a49-41fa-a188-d41593d91cb9
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-18c9b60c-0b2a-49c1-bce1-9042f3a2e5f2 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.302s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-9e6c6afa-d157-437f-8784-a73650c2809b req-6cabe356-f2be-4c35-a49b-b77f611588f1 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Received event network-vif-plugged-a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9e6c6afa-d157-437f-8784-a73650c2809b req-6cabe356-f2be-4c35-a49b-b77f611588f1 service nova] Acquiring lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9e6c6afa-d157-437f-8784-a73650c2809b req-6cabe356-f2be-4c35-a49b-b77f611588f1 service nova] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9e6c6afa-d157-437f-8784-a73650c2809b req-6cabe356-f2be-4c35-a49b-b77f611588f1 service nova] Lock "8b08db54-6a49-41fa-a188-d41593d91cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-9e6c6afa-d157-437f-8784-a73650c2809b req-6cabe356-f2be-4c35-a49b-b77f611588f1 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] No waiting events found dispatching network-vif-plugged-a193ca5a-05d4-414e-a041-ec300eee1a08 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:54:21 user nova-compute[76161]: WARNING nova.compute.manager [req-9e6c6afa-d157-437f-8784-a73650c2809b req-6cabe356-f2be-4c35-a49b-b77f611588f1 service nova] [instance: 8b08db54-6a49-41fa-a188-d41593d91cb9] Received unexpected event network-vif-plugged-a193ca5a-05d4-414e-a041-ec300eee1a08 for instance with vm_state deleted and task_state None.
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:22 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:54:22 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7004MB free_disk=25.258544921875GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Applying migration context for instance 56f47238-81fe-4196-865c-e1ad68cf6fea as it has an incoming, in-progress migration bf20f369-2efa-413f-bf27-d76d1098bcf1. Migration status is finished {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 17:54:22 user nova-compute[76161]: INFO nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating resource usage from migration bf20f369-2efa-413f-bf27-d76d1098bcf1
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 678e458a-aeb6-4f29-b20b-74115179025f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b37a7f95-b429-431a-b837-a650fd1ee27e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56848a92-97b3-4eef-b924-de8ab85ad115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Migration bf20f369-2efa-413f-bf27-d76d1098bcf1 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56f47238-81fe-4196-865c-e1ad68cf6fea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 76193048-410d-4a59-9eb5-165d8ce0af6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a1ec772d-0eee-460f-8f52-2daeda1a3232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance f0a6ae6f-72f6-4357-8fe6-a327549d1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance fdcdc21a-3601-4f26-8da3-f345c35d839d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:54:22 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:54:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:54:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-e8340e96-32d5-4448-a944-d59c4896df8c req-d8b3178d-8f86-4e72-b1e4-fb5bcb68a0ca service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-changed-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-e8340e96-32d5-4448-a944-d59c4896df8c req-d8b3178d-8f86-4e72-b1e4-fb5bcb68a0ca service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Refreshing instance network info cache due to event network-changed-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:54:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e8340e96-32d5-4448-a944-d59c4896df8c req-d8b3178d-8f86-4e72-b1e4-fb5bcb68a0ca service nova] Acquiring lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:54:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e8340e96-32d5-4448-a944-d59c4896df8c req-d8b3178d-8f86-4e72-b1e4-fb5bcb68a0ca service nova] Acquired lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:54:24 user nova-compute[76161]: DEBUG nova.network.neutron [req-e8340e96-32d5-4448-a944-d59c4896df8c req-d8b3178d-8f86-4e72-b1e4-fb5bcb68a0ca service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Refreshing network info cache for port efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:54:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "interface-b37a7f95-b429-431a-b837-a650fd1ee27e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "interface-b37a7f95-b429-431a-b837-a650fd1ee27e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG nova.objects.instance [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lazy-loading 'flavor' on Instance uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG nova.objects.instance [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lazy-loading 'pci_requests' on Instance uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG nova.objects.base [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Object Instance<b37a7f95-b429-431a-b837-a650fd1ee27e> lazy-loaded attributes: flavor,pci_requests {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG nova.policy [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f77ddf30c3a4891991fd2bb6e95b297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b442ba233de4096a5e0fa2e04d0853f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG nova.network.neutron [req-e8340e96-32d5-4448-a944-d59c4896df8c req-d8b3178d-8f86-4e72-b1e4-fb5bcb68a0ca service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updated VIF entry in instance network info cache for port efc2c7fd-10f7-4ecc-a87d-c2f0c010d992. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG nova.network.neutron [req-e8340e96-32d5-4448-a944-d59c4896df8c req-d8b3178d-8f86-4e72-b1e4-fb5bcb68a0ca service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updating instance_info_cache with network_info: [{"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e8340e96-32d5-4448-a944-d59c4896df8c req-d8b3178d-8f86-4e72-b1e4-fb5bcb68a0ca service nova] Releasing lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:54:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Successfully created port: 3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:54:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Successfully updated port: 3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:54:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:54:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquired lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:54:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:54:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-14b27e8e-eb58-4f50-bd81-13e5fe195264 req-d978c31c-0b4f-45be-88b9-ea4d4cac8bfe service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-changed-3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-14b27e8e-eb58-4f50-bd81-13e5fe195264 req-d978c31c-0b4f-45be-88b9-ea4d4cac8bfe service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Refreshing instance network info cache due to event network-changed-3be17c85-687c-4e56-a1b8-9af5cee15ed2. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:54:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-14b27e8e-eb58-4f50-bd81-13e5fe195264 req-d978c31c-0b4f-45be-88b9-ea4d4cac8bfe service nova] Acquiring lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updating instance_info_cache with network_info: [{"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Releasing lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-14b27e8e-eb58-4f50-bd81-13e5fe195264 req-d978c31c-0b4f-45be-88b9-ea4d4cac8bfe service nova] Acquired lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-14b27e8e-eb58-4f50-bd81-13e5fe195264 req-d978c31c-0b4f-45be-88b9-ea4d4cac8bfe service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Refreshing network info cache for port 3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235698834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235698834',id=16,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL15D+kMQspaKeW7+Bx5Dn7IFwRs/JMwFGq2/FmaQr23P9jWrQHvM1225hzBmTZF7rA/Hf1M98y9sJNaTlvjxHJCuE4gTpn+otFGMWDM/pMcafW1YhRqWDPdGRMGZKc0pw==',key_name='tempest-keypair-813492960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b442ba233de4096a5e0fa2e04d0853f',ramdisk_id='',reservation_id='r-qyf2fo90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-894639612',owner_user_name='tempest-TaggedAttachmentsTest-894639612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f77ddf30c3a4891991fd2bb6e95b297',uuid=b37a7f95-b429-431a-b837-a650fd1ee27e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converting VIF {"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG os_vif [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '714fe57b-1160-51b9-a3dc-0b25f4d342d7', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3be17c85-68, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3be17c85-68, col_values=(('qos', UUID('17ca365e-33a6-45eb-9dfd-f68ae7a1c558')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3be17c85-68, col_values=(('external_ids', {'iface-id': '3be17c85-687c-4e56-a1b8-9af5cee15ed2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:c8:2b', 'vm-uuid': 'b37a7f95-b429-431a-b837-a650fd1ee27e'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:27 user nova-compute[76161]: INFO os_vif [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68')
Nov 14 17:54:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235698834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235698834',id=16,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL15D+kMQspaKeW7+Bx5Dn7IFwRs/JMwFGq2/FmaQr23P9jWrQHvM1225hzBmTZF7rA/Hf1M98y9sJNaTlvjxHJCuE4gTpn+otFGMWDM/pMcafW1YhRqWDPdGRMGZKc0pw==',key_name='tempest-keypair-813492960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b442ba233de4096a5e0fa2e04d0853f',ramdisk_id='',reservation_id='r-qyf2fo90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-894639612',owner_user_name='tempest-TaggedAttachmentsTest-894639612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f77ddf30c3a4891991fd2bb6e95b297',uuid=b37a7f95-b429-431a-b837-a650fd1ee27e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converting VIF {"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] attach device xml: <interface type="ethernet">
Nov 14 17:54:27 user nova-compute[76161]:   <mac address="fa:16:3e:2e:c8:2b"/>
Nov 14 17:54:27 user nova-compute[76161]:   <model type="virtio"/>
Nov 14 17:54:27 user nova-compute[76161]:   <mtu size="1442"/>
Nov 14 17:54:27 user nova-compute[76161]:   <target dev="tap3be17c85-68"/>
Nov 14 17:54:27 user nova-compute[76161]: </interface>
Nov 14 17:54:27 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] No BDM found with device name hda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] No VIF found with MAC fa:16:3e:9d:da:2c, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:54:28 user nova-compute[76161]:   <nova:package version="0.0.0"/>
Nov 14 17:54:28 user nova-compute[76161]:   <nova:name>tempest-device-tagging-server-235698834</nova:name>
Nov 14 17:54:28 user nova-compute[76161]:   <nova:creationTime>2023-11-14 17:54:28</nova:creationTime>
Nov 14 17:54:28 user nova-compute[76161]:   <nova:flavor name="m1.tiny">
Nov 14 17:54:28 user nova-compute[76161]:     <nova:memory>512</nova:memory>
Nov 14 17:54:28 user nova-compute[76161]:     <nova:disk>1</nova:disk>
Nov 14 17:54:28 user nova-compute[76161]:     <nova:swap>0</nova:swap>
Nov 14 17:54:28 user nova-compute[76161]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:54:28 user nova-compute[76161]:     <nova:vcpus>1</nova:vcpus>
Nov 14 17:54:28 user nova-compute[76161]:   </nova:flavor>
Nov 14 17:54:28 user nova-compute[76161]:   <nova:owner>
Nov 14 17:54:28 user nova-compute[76161]:     <nova:user uuid="1f77ddf30c3a4891991fd2bb6e95b297">tempest-TaggedAttachmentsTest-894639612-project-member</nova:user>
Nov 14 17:54:28 user nova-compute[76161]:     <nova:project uuid="3b442ba233de4096a5e0fa2e04d0853f">tempest-TaggedAttachmentsTest-894639612</nova:project>
Nov 14 17:54:28 user nova-compute[76161]:   </nova:owner>
Nov 14 17:54:28 user nova-compute[76161]:   <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:54:28 user nova-compute[76161]:   <nova:ports>
Nov 14 17:54:28 user nova-compute[76161]:     <nova:port uuid="efc2c7fd-10f7-4ecc-a87d-c2f0c010d992">
Nov 14 17:54:28 user nova-compute[76161]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:54:28 user nova-compute[76161]:     </nova:port>
Nov 14 17:54:28 user nova-compute[76161]:     <nova:port uuid="3be17c85-687c-4e56-a1b8-9af5cee15ed2">
Nov 14 17:54:28 user nova-compute[76161]:       <nova:ip type="fixed" address="10.10.10.111" ipVersion="4"/>
Nov 14 17:54:28 user nova-compute[76161]:     </nova:port>
Nov 14 17:54:28 user nova-compute[76161]:   </nova:ports>
Nov 14 17:54:28 user nova-compute[76161]: </nova:instance>
Nov 14 17:54:28 user nova-compute[76161]:  {{(pid=76161) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-27942d46-951c-4eb2-bff5-74e70eb4d3c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "interface-b37a7f95-b429-431a-b837-a650fd1ee27e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.093s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.network.neutron [req-14b27e8e-eb58-4f50-bd81-13e5fe195264 req-d978c31c-0b4f-45be-88b9-ea4d4cac8bfe service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updated VIF entry in instance network info cache for port 3be17c85-687c-4e56-a1b8-9af5cee15ed2. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.network.neutron [req-14b27e8e-eb58-4f50-bd81-13e5fe195264 req-d978c31c-0b4f-45be-88b9-ea4d4cac8bfe service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updating instance_info_cache with network_info: [{"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-14b27e8e-eb58-4f50-bd81-13e5fe195264 req-d978c31c-0b4f-45be-88b9-ea4d4cac8bfe service nova] Releasing lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.objects.instance [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lazy-loading 'flavor' on Instance uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:28 user nova-compute[76161]: INFO nova.compute.manager [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Attaching volume 50677ae0-c3a6-4e62-acd7-7fab1659d5b1 to /dev/vdb
Nov 14 17:54:28 user nova-compute[76161]: DEBUG os_brick.utils [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145ff23-c40f-486f-8bcf-c2e1be5add95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae39e2a1-427f-4642-ab5b-8894630eaf50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d3343f-e2b0-4dc4-8ba5-d99aee032d82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[58376d0e-b0ad-4632-8e98-d2eea4512f09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:54:28 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d613b56-1828-466e-8800-2f11ca3ca29f]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG os_brick.utils [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updating existing volume attachment record: f835213a-2f23-429d-97a6-a0d5458ba2a7 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-plugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-plugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:54:28 user nova-compute[76161]: WARNING nova.compute.manager [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-plugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 for instance with vm_state active and task_state None.
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-plugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-plugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:54:28 user nova-compute[76161]: WARNING nova.compute.manager [req-3042c465-e7ae-4de6-bc31-ff1cd3ef0ed0 req-8c31545e-4d7d-45e3-a72a-89642a589621 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-plugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 for instance with vm_state active and task_state None.
Nov 14 17:54:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vudhjBqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:54:33 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:54:33 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:54:33 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7886103a-a409-4ff6-95d3-b0dc00b80904]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:54:33 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa56074-1762-4bb2-9e9f-b679d29367c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1] added
Nov 14 17:54:33 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caf9a1b-9a7a-4fab-93b1-1f796be9dd47]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[685ced93-831f-4f06-a395-e1381a59cdae]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vudhjBqD {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vudhjBqD" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a8a931-a79e-485d-8f10-e4b30f09ee2e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vudhjBqD'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab0b39b-2608-4df2-bd2e-f00dc2982ecc]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d495d5cb-f8b9-4476-9302-a327a58a784c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:54:33 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:54:33 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:54:33 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:54:33 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[331d4cf8-9c68-4f8c-9977-ade763671e8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1, portal: 172.16.0.220,3260]
Nov 14 17:54:33 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1, portal: 172.16.0.220,3260] successful.
Nov 14 17:54:33 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c067813a-7093-4837-b2f5-ad4382c914d0]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ff1dd9-60b1-4bc4-bfb7-042acff78bce]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:54:33 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:54:33 user nova-compute[76161]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 (non-flash)
Nov 14 17:54:33 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:54:33 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:54:33 user nova-compute[76161]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 (non-flash)
Nov 14 17:54:33 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a89f4f-ab86-4f5e-9676-8b956c3567bc]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:33 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:54:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:54:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vudhjBqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:54:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:54:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23630633361323332', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:54:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630633361323332', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:54:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lazy-loading 'flavor' on Instance uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:54:34 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:54:34 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 17:54:34 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:54:34 user nova-compute[76161]:   <serial>50677ae0-c3a6-4e62-acd7-7fab1659d5b1</serial>
Nov 14 17:54:34 user nova-compute[76161]: </disk>
Nov 14 17:54:34 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:54:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:54:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] No BDM found with device name hda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:54:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] No VIF found with MAC fa:16:3e:9d:da:2c, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:54:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-67285293-dd82-4882-ae09-2e525f1e5911 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.506s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:37 user nova-compute[76161]: INFO nova.compute.manager [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Detaching volume 50677ae0-c3a6-4e62-acd7-7fab1659d5b1
Nov 14 17:54:37 user nova-compute[76161]: INFO nova.virt.block_device [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Attempting to driver detach volume 50677ae0-c3a6-4e62-acd7-7fab1659d5b1 from mountpoint /dev/vdb
Nov 14 17:54:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Attempting to detach device vdb from instance b37a7f95-b429-431a-b837-a650fd1ee27e from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:54:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:54:37 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:54:37 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 17:54:37 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:54:37 user nova-compute[76161]:   <serial>50677ae0-c3a6-4e62-acd7-7fab1659d5b1</serial>
Nov 14 17:54:37 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 17:54:37 user nova-compute[76161]: </disk>
Nov 14 17:54:37 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:54:37 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Successfully detached device vdb from instance b37a7f95-b429-431a-b837-a650fd1ee27e from the persistent domain config.
Nov 14 17:54:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b37a7f95-b429-431a-b837-a650fd1ee27e from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:54:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:54:37 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:54:37 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 17:54:37 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:54:37 user nova-compute[76161]:   <serial>50677ae0-c3a6-4e62-acd7-7fab1659d5b1</serial>
Nov 14 17:54:37 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 17:54:37 user nova-compute[76161]: </disk>
Nov 14 17:54:37 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:54:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:54:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:56 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:54:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:56 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:54:56 user nova-compute[76161]: INFO nova.compute.claims [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Claim successful on node user
Nov 14 17:54:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.822s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:54:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:54:57 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b37a7f95-b429-431a-b837-a650fd1ee27e is timed out.
Nov 14 17:54:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Successfully detached device vdb from instance b37a7f95-b429-431a-b837-a650fd1ee27e from the live domain config.
Nov 14 17:54:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vudhjBqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:54:57 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7851b8fa-354a-411a-9253-79feeadaa0e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:54:57 user nova-compute[76161]: No targets found.
Nov 14 17:54:57 user nova-compute[76161]: iSNS:
Nov 14 17:54:57 user nova-compute[76161]: No targets found.
Nov 14 17:54:57 user nova-compute[76161]: STATIC:
Nov 14 17:54:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1
Nov 14 17:54:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:54:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:54:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:54:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:54:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:54:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:54:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:54:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:54:57 user nova-compute[76161]: FIRMWARE:
Nov 14 17:54:57 user nova-compute[76161]: No targets found.
Nov 14 17:54:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:54:57 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:54:57 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65da4c6-04a8-419a-8ba6-ac2e26fce525]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG nova.policy [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '220334ba1c7744c68e1bd8c2c5c20749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72de616ddd04286a9946e5727b76e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[329d3db6-1a0f-4f12-84cb-16a827749711]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:54:57 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:54:57 user nova-compute[76161]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 (non-flash)
Nov 14 17:54:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:54:57 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:54:57 user nova-compute[76161]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 (non-flash)
Nov 14 17:54:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0172f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0a96f9-da5d-462f-9405-3230e176caad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:54:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Creating image(s)
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "/opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "/opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ae8d09-b144-40a2-a87e-9c20173f430a]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[909c7075-439d-4467-9cf3-86e3b94ca2da]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cdd732-0f7e-4d0c-94d6-530656872846]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:54:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf23f61-7c70-44a2-a033-a4a03f905a8c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[be55174d-5303-4580-bb1b-b66d330e497e]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1, portal: 172.16.0.220,3260]
Nov 14 17:54:58 user nova-compute[76161]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1, portal: 172.16.0.220,3260] successful.
Nov 14 17:54:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50677ae0-c3a6-4e62-acd7-7fab1659d5b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9e3c49-d20a-4bf0-bad5-bce95cb19764]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] <== disconnect_volume: return (373ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk 1073741824" returned: 0 in 0.044s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Successfully created port: 69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.198s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Cannot resize image /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Ensure instance console log exists: /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG nova.objects.instance [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lazy-loading 'flavor' on Instance uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4444cdee-401d-466b-be12-b1f02a04e458 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.776s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Successfully updated port: 69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquired lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-9ec95c20-3275-41bb-b0b5-9cd9dd188d87 req-a78b9b17-276a-4f93-bab1-ebde15bb26a6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received event network-changed-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-9ec95c20-3275-41bb-b0b5-9cd9dd188d87 req-a78b9b17-276a-4f93-bab1-ebde15bb26a6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Refreshing instance network info cache due to event network-changed-69b8f81e-f7ba-4056-ba8b-5493d55616c8. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9ec95c20-3275-41bb-b0b5-9cd9dd188d87 req-a78b9b17-276a-4f93-bab1-ebde15bb26a6 service nova] Acquiring lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updating instance_info_cache with network_info: [{"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Releasing lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Instance network_info: |[{"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9ec95c20-3275-41bb-b0b5-9cd9dd188d87 req-a78b9b17-276a-4f93-bab1-ebde15bb26a6 service nova] Acquired lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.neutron [req-9ec95c20-3275-41bb-b0b5-9cd9dd188d87 req-a78b9b17-276a-4f93-bab1-ebde15bb26a6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Refreshing network info cache for port 69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Start _get_guest_xml network_info=[{"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:54:59 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:54:59 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1572864524',display_name='tempest-TestStampPattern-server-1572864524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1572864524',id=22,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVn++uY914nMT4ppedFhS8d3dW25Wn2Uz3D0CtpuFA7uYKjt5LP3wVNJBoX8K7AIEJk32VFPhZsLSf9W5T1bKCgwU7sl5Ok2efZd0OuAxtFgTYFlNfvMQAY6AUQQc/vkg==',key_name='tempest-TestStampPattern-1685336557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b72de616ddd04286a9946e5727b76e85',ramdisk_id='',reservation_id='r-7j140lyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1566874307',owner_user_name='tempest-TestStampPattern-1566874307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:54:58Z,user_data=None,user_id='220334ba1c7744c68e1bd8c2c5c20749',uuid=6e87b617-e12f-4c33-bd5d-8f1bc07c417b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converting VIF {"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=69b8f81e-f7ba-4056-ba8b-5493d55616c8,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8f81e-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.objects.instance [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e87b617-e12f-4c33-bd5d-8f1bc07c417b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:54:59 user nova-compute[76161]:   <uuid>6e87b617-e12f-4c33-bd5d-8f1bc07c417b</uuid>
Nov 14 17:54:59 user nova-compute[76161]:   <name>instance-00000016</name>
Nov 14 17:54:59 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:54:59 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:54:59 user nova-compute[76161]:   <metadata>
Nov 14 17:54:59 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:54:59 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:54:59 user nova-compute[76161]:       <nova:name>tempest-TestStampPattern-server-1572864524</nova:name>
Nov 14 17:54:59 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:54:59</nova:creationTime>
Nov 14 17:54:59 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:54:59 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:54:59 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:54:59 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:54:59 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:54:59 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:54:59 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:54:59 user nova-compute[76161]:       <nova:owner>
Nov 14 17:54:59 user nova-compute[76161]:         <nova:user uuid="220334ba1c7744c68e1bd8c2c5c20749">tempest-TestStampPattern-1566874307-project-member</nova:user>
Nov 14 17:54:59 user nova-compute[76161]:         <nova:project uuid="b72de616ddd04286a9946e5727b76e85">tempest-TestStampPattern-1566874307</nova:project>
Nov 14 17:54:59 user nova-compute[76161]:       </nova:owner>
Nov 14 17:54:59 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:54:59 user nova-compute[76161]:       <nova:ports>
Nov 14 17:54:59 user nova-compute[76161]:         <nova:port uuid="69b8f81e-f7ba-4056-ba8b-5493d55616c8">
Nov 14 17:54:59 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 17:54:59 user nova-compute[76161]:         </nova:port>
Nov 14 17:54:59 user nova-compute[76161]:       </nova:ports>
Nov 14 17:54:59 user nova-compute[76161]:     </nova:instance>
Nov 14 17:54:59 user nova-compute[76161]:   </metadata>
Nov 14 17:54:59 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:54:59 user nova-compute[76161]:     <system>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name="serial">6e87b617-e12f-4c33-bd5d-8f1bc07c417b</entry>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name="uuid">6e87b617-e12f-4c33-bd5d-8f1bc07c417b</entry>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:54:59 user nova-compute[76161]:     </system>
Nov 14 17:54:59 user nova-compute[76161]:   </sysinfo>
Nov 14 17:54:59 user nova-compute[76161]:   <os>
Nov 14 17:54:59 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:54:59 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:54:59 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:54:59 user nova-compute[76161]:   </os>
Nov 14 17:54:59 user nova-compute[76161]:   <features>
Nov 14 17:54:59 user nova-compute[76161]:     <acpi/>
Nov 14 17:54:59 user nova-compute[76161]:     <apic/>
Nov 14 17:54:59 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:54:59 user nova-compute[76161]:   </features>
Nov 14 17:54:59 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:54:59 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:54:59 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:54:59 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:54:59 user nova-compute[76161]:   </clock>
Nov 14 17:54:59 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:54:59 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:54:59 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:54:59 user nova-compute[76161]:   </cpu>
Nov 14 17:54:59 user nova-compute[76161]:   <devices>
Nov 14 17:54:59 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:54:59 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:54:59 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk"/>
Nov 14 17:54:59 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:54:59 user nova-compute[76161]:     </disk>
Nov 14 17:54:59 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:54:59 user nova-compute[76161]:       <mac address="fa:16:3e:9b:b5:e3"/>
Nov 14 17:54:59 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:54:59 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:54:59 user nova-compute[76161]:       <target dev="tap69b8f81e-f7"/>
Nov 14 17:54:59 user nova-compute[76161]:     </interface>
Nov 14 17:54:59 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:54:59 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/console.log" append="off"/>
Nov 14 17:54:59 user nova-compute[76161]:     </serial>
Nov 14 17:54:59 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:54:59 user nova-compute[76161]:     <video>
Nov 14 17:54:59 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:54:59 user nova-compute[76161]:     </video>
Nov 14 17:54:59 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:54:59 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:54:59 user nova-compute[76161]:     </rng>
Nov 14 17:54:59 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:54:59 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:54:59 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:54:59 user nova-compute[76161]:     </memballoon>
Nov 14 17:54:59 user nova-compute[76161]:   </devices>
Nov 14 17:54:59 user nova-compute[76161]: </domain>
Nov 14 17:54:59 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1572864524',display_name='tempest-TestStampPattern-server-1572864524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1572864524',id=22,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVn++uY914nMT4ppedFhS8d3dW25Wn2Uz3D0CtpuFA7uYKjt5LP3wVNJBoX8K7AIEJk32VFPhZsLSf9W5T1bKCgwU7sl5Ok2efZd0OuAxtFgTYFlNfvMQAY6AUQQc/vkg==',key_name='tempest-TestStampPattern-1685336557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b72de616ddd04286a9946e5727b76e85',ramdisk_id='',reservation_id='r-7j140lyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1566874307',owner_user_name='tempest-TestStampPattern-1566874307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:54:58Z,user_data=None,user_id='220334ba1c7744c68e1bd8c2c5c20749',uuid=6e87b617-e12f-4c33-bd5d-8f1bc07c417b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converting VIF {"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=69b8f81e-f7ba-4056-ba8b-5493d55616c8,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8f81e-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG os_vif [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=69b8f81e-f7ba-4056-ba8b-5493d55616c8,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8f81e-f7') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e72dcc7-bf1c-5fbe-9331-6bc06a816f5f', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69b8f81e-f7, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69b8f81e-f7, col_values=(('qos', UUID('444ec1bf-5330-4d62-81c9-6f40a638dc61')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69b8f81e-f7, col_values=(('external_ids', {'iface-id': '69b8f81e-f7ba-4056-ba8b-5493d55616c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:b5:e3', 'vm-uuid': '6e87b617-e12f-4c33-bd5d-8f1bc07c417b'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:54:59 user nova-compute[76161]: INFO os_vif [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=69b8f81e-f7ba-4056-ba8b-5493d55616c8,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8f81e-f7')
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] No VIF found with MAC fa:16:3e:9b:b5:e3, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "interface-b37a7f95-b429-431a-b837-a650fd1ee27e-3be17c85-687c-4e56-a1b8-9af5cee15ed2" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "interface-b37a7f95-b429-431a-b837-a650fd1ee27e-3be17c85-687c-4e56-a1b8-9af5cee15ed2" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.objects.instance [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lazy-loading 'flavor' on Instance uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235698834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235698834',id=16,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL15D+kMQspaKeW7+Bx5Dn7IFwRs/JMwFGq2/FmaQr23P9jWrQHvM1225hzBmTZF7rA/Hf1M98y9sJNaTlvjxHJCuE4gTpn+otFGMWDM/pMcafW1YhRqWDPdGRMGZKc0pw==',key_name='tempest-keypair-813492960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b442ba233de4096a5e0fa2e04d0853f',ramdisk_id='',reservation_id='r-qyf2fo90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-894639612',owner_user_name='tempest-TaggedAttachmentsTest-894639612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f77ddf30c3a4891991fd2bb6e95b297',uuid=b37a7f95-b429-431a-b837-a650fd1ee27e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converting VIF {"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2e:c8:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3be17c85-68"/></interface> {{(pid=76161) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2e:c8:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3be17c85-68"/></interface> {{(pid=76161) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Attempting to detach device tap3be17c85-68 from instance b37a7f95-b429-431a-b837-a650fd1ee27e from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] detach device xml: <interface type="ethernet">
Nov 14 17:54:59 user nova-compute[76161]:   <mac address="fa:16:3e:2e:c8:2b"/>
Nov 14 17:54:59 user nova-compute[76161]:   <model type="virtio"/>
Nov 14 17:54:59 user nova-compute[76161]:   <mtu size="1442"/>
Nov 14 17:54:59 user nova-compute[76161]:   <target dev="tap3be17c85-68"/>
Nov 14 17:54:59 user nova-compute[76161]: </interface>
Nov 14 17:54:59 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2e:c8:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3be17c85-68"/></interface> {{(pid=76161) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2e:c8:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3be17c85-68"/></interface>not found in domain: <domain type='kvm' id='17'>
Nov 14 17:54:59 user nova-compute[76161]:   <name>instance-00000010</name>
Nov 14 17:54:59 user nova-compute[76161]:   <uuid>b37a7f95-b429-431a-b837-a650fd1ee27e</uuid>
Nov 14 17:54:59 user nova-compute[76161]:   <metadata>
Nov 14 17:54:59 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:54:59 user nova-compute[76161]:   <nova:package version="0.0.0"/>
Nov 14 17:54:59 user nova-compute[76161]:   <nova:name>tempest-device-tagging-server-235698834</nova:name>
Nov 14 17:54:59 user nova-compute[76161]:   <nova:creationTime>2023-11-14 17:54:28</nova:creationTime>
Nov 14 17:54:59 user nova-compute[76161]:   <nova:flavor name="m1.tiny">
Nov 14 17:54:59 user nova-compute[76161]:     <nova:memory>512</nova:memory>
Nov 14 17:54:59 user nova-compute[76161]:     <nova:disk>1</nova:disk>
Nov 14 17:54:59 user nova-compute[76161]:     <nova:swap>0</nova:swap>
Nov 14 17:54:59 user nova-compute[76161]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:54:59 user nova-compute[76161]:     <nova:vcpus>1</nova:vcpus>
Nov 14 17:54:59 user nova-compute[76161]:   </nova:flavor>
Nov 14 17:54:59 user nova-compute[76161]:   <nova:owner>
Nov 14 17:54:59 user nova-compute[76161]:     <nova:user uuid="1f77ddf30c3a4891991fd2bb6e95b297">tempest-TaggedAttachmentsTest-894639612-project-member</nova:user>
Nov 14 17:54:59 user nova-compute[76161]:     <nova:project uuid="3b442ba233de4096a5e0fa2e04d0853f">tempest-TaggedAttachmentsTest-894639612</nova:project>
Nov 14 17:54:59 user nova-compute[76161]:   </nova:owner>
Nov 14 17:54:59 user nova-compute[76161]:   <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:54:59 user nova-compute[76161]:   <nova:ports>
Nov 14 17:54:59 user nova-compute[76161]:     <nova:port uuid="efc2c7fd-10f7-4ecc-a87d-c2f0c010d992">
Nov 14 17:54:59 user nova-compute[76161]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:54:59 user nova-compute[76161]:     </nova:port>
Nov 14 17:54:59 user nova-compute[76161]:     <nova:port uuid="3be17c85-687c-4e56-a1b8-9af5cee15ed2">
Nov 14 17:54:59 user nova-compute[76161]:       <nova:ip type="fixed" address="10.10.10.111" ipVersion="4"/>
Nov 14 17:54:59 user nova-compute[76161]:     </nova:port>
Nov 14 17:54:59 user nova-compute[76161]:   </nova:ports>
Nov 14 17:54:59 user nova-compute[76161]: </nova:instance>
Nov 14 17:54:59 user nova-compute[76161]:   </metadata>
Nov 14 17:54:59 user nova-compute[76161]:   <memory unit='KiB'>524288</memory>
Nov 14 17:54:59 user nova-compute[76161]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 17:54:59 user nova-compute[76161]:   <vcpu placement='static'>1</vcpu>
Nov 14 17:54:59 user nova-compute[76161]:   <resource>
Nov 14 17:54:59 user nova-compute[76161]:     <partition>/machine</partition>
Nov 14 17:54:59 user nova-compute[76161]:   </resource>
Nov 14 17:54:59 user nova-compute[76161]:   <sysinfo type='smbios'>
Nov 14 17:54:59 user nova-compute[76161]:     <system>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name='version'>0.0.0</entry>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name='serial'>b37a7f95-b429-431a-b837-a650fd1ee27e</entry>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name='uuid'>b37a7f95-b429-431a-b837-a650fd1ee27e</entry>
Nov 14 17:54:59 user nova-compute[76161]:       <entry name='family'>Virtual Machine</entry>
Nov 14 17:54:59 user nova-compute[76161]:     </system>
Nov 14 17:54:59 user nova-compute[76161]:   </sysinfo>
Nov 14 17:54:59 user nova-compute[76161]:   <os>
Nov 14 17:54:59 user nova-compute[76161]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 17:54:59 user nova-compute[76161]:     <boot dev='hd'/>
Nov 14 17:54:59 user nova-compute[76161]:     <smbios mode='sysinfo'/>
Nov 14 17:54:59 user nova-compute[76161]:   </os>
Nov 14 17:54:59 user nova-compute[76161]:   <features>
Nov 14 17:54:59 user nova-compute[76161]:     <acpi/>
Nov 14 17:54:59 user nova-compute[76161]:     <apic/>
Nov 14 17:54:59 user nova-compute[76161]:     <vmcoreinfo state='on'/>
Nov 14 17:54:59 user nova-compute[76161]:   </features>
Nov 14 17:54:59 user nova-compute[76161]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 17:54:59 user nova-compute[76161]:     <model fallback='forbid'>Nehalem</model>
Nov 14 17:54:59 user nova-compute[76161]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 17:54:59 user nova-compute[76161]:     <feature policy='require' name='vme'/>
Nov 14 17:54:59 user nova-compute[76161]:     <feature policy='require' name='x2apic'/>
Nov 14 17:54:59 user nova-compute[76161]:     <feature policy='require' name='hypervisor'/>
Nov 14 17:54:59 user nova-compute[76161]:   </cpu>
Nov 14 17:54:59 user nova-compute[76161]:   <clock offset='utc'>
Nov 14 17:54:59 user nova-compute[76161]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 17:54:59 user nova-compute[76161]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 17:54:59 user nova-compute[76161]:     <timer name='hpet' present='no'/>
Nov 14 17:54:59 user nova-compute[76161]:   </clock>
Nov 14 17:54:59 user nova-compute[76161]:   <on_poweroff>destroy</on_poweroff>
Nov 14 17:54:59 user nova-compute[76161]:   <on_reboot>restart</on_reboot>
Nov 14 17:54:59 user nova-compute[76161]:   <on_crash>destroy</on_crash>
Nov 14 17:54:59 user nova-compute[76161]:   <devices>
Nov 14 17:54:59 user nova-compute[76161]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 17:54:59 user nova-compute[76161]:     <disk type='file' device='disk'>
Nov 14 17:54:59 user nova-compute[76161]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 17:54:59 user nova-compute[76161]:       <source file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk' index='2'/>
Nov 14 17:54:59 user nova-compute[76161]:       <backingStore type='file' index='3'>
Nov 14 17:54:59 user nova-compute[76161]:         <format type='raw'/>
Nov 14 17:54:59 user nova-compute[76161]:         <source file='/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d'/>
Nov 14 17:54:59 user nova-compute[76161]:         <backingStore/>
Nov 14 17:54:59 user nova-compute[76161]:       </backingStore>
Nov 14 17:54:59 user nova-compute[76161]:       <target dev='vda' bus='virtio'/>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='virtio-disk0'/>
Nov 14 17:54:59 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </disk>
Nov 14 17:54:59 user nova-compute[76161]:     <disk type='file' device='cdrom'>
Nov 14 17:54:59 user nova-compute[76161]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 17:54:59 user nova-compute[76161]:       <source file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.config' index='1'/>
Nov 14 17:54:59 user nova-compute[76161]:       <backingStore/>
Nov 14 17:54:59 user nova-compute[76161]:       <target dev='hda' bus='ide'/>
Nov 14 17:54:59 user nova-compute[76161]:       <readonly/>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='ide0-0-0'/>
Nov 14 17:54:59 user nova-compute[76161]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </disk>
Nov 14 17:54:59 user nova-compute[76161]:     <controller type='usb' index='0' model='none'>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='usb'/>
Nov 14 17:54:59 user nova-compute[76161]:     </controller>
Nov 14 17:54:59 user nova-compute[76161]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='pci.0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </controller>
Nov 14 17:54:59 user nova-compute[76161]:     <controller type='ide' index='0'>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='ide'/>
Nov 14 17:54:59 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 17:54:59 user nova-compute[76161]:     </controller>
Nov 14 17:54:59 user nova-compute[76161]:     <interface type='ethernet'>
Nov 14 17:54:59 user nova-compute[76161]:       <mac address='fa:16:3e:9d:da:2c'/>
Nov 14 17:54:59 user nova-compute[76161]:       <target dev='tapefc2c7fd-10'/>
Nov 14 17:54:59 user nova-compute[76161]:       <model type='virtio'/>
Nov 14 17:54:59 user nova-compute[76161]:       <mtu size='1442'/>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='net0'/>
Nov 14 17:54:59 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </interface>
Nov 14 17:54:59 user nova-compute[76161]:     <interface type='ethernet'>
Nov 14 17:54:59 user nova-compute[76161]:       <mac address='fa:16:3e:2e:c8:2b'/>
Nov 14 17:54:59 user nova-compute[76161]:       <target dev='tap3be17c85-68'/>
Nov 14 17:54:59 user nova-compute[76161]:       <model type='virtio'/>
Nov 14 17:54:59 user nova-compute[76161]:       <mtu size='1442'/>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='net1'/>
Nov 14 17:54:59 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </interface>
Nov 14 17:54:59 user nova-compute[76161]:     <serial type='pty'>
Nov 14 17:54:59 user nova-compute[76161]:       <source path='/dev/pts/7'/>
Nov 14 17:54:59 user nova-compute[76161]:       <log file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/console.log' append='off'/>
Nov 14 17:54:59 user nova-compute[76161]:       <target type='isa-serial' port='0'>
Nov 14 17:54:59 user nova-compute[76161]:         <model name='isa-serial'/>
Nov 14 17:54:59 user nova-compute[76161]:       </target>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='serial0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </serial>
Nov 14 17:54:59 user nova-compute[76161]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 17:54:59 user nova-compute[76161]:       <source path='/dev/pts/7'/>
Nov 14 17:54:59 user nova-compute[76161]:       <log file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/console.log' append='off'/>
Nov 14 17:54:59 user nova-compute[76161]:       <target type='serial' port='0'/>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='serial0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </console>
Nov 14 17:54:59 user nova-compute[76161]:     <input type='mouse' bus='ps2'>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='input0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </input>
Nov 14 17:54:59 user nova-compute[76161]:     <input type='keyboard' bus='ps2'>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='input1'/>
Nov 14 17:54:59 user nova-compute[76161]:     </input>
Nov 14 17:54:59 user nova-compute[76161]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Nov 14 17:54:59 user nova-compute[76161]:       <listen type='address' address='0.0.0.0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </graphics>
Nov 14 17:54:59 user nova-compute[76161]:     <audio id='1' type='none'/>
Nov 14 17:54:59 user nova-compute[76161]:     <video>
Nov 14 17:54:59 user nova-compute[76161]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='video0'/>
Nov 14 17:54:59 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </video>
Nov 14 17:54:59 user nova-compute[76161]:     <memballoon model='virtio'>
Nov 14 17:54:59 user nova-compute[76161]:       <stats period='10'/>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='balloon0'/>
Nov 14 17:54:59 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </memballoon>
Nov 14 17:54:59 user nova-compute[76161]:     <rng model='virtio'>
Nov 14 17:54:59 user nova-compute[76161]:       <backend model='random'>/dev/urandom</backend>
Nov 14 17:54:59 user nova-compute[76161]:       <alias name='rng0'/>
Nov 14 17:54:59 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 17:54:59 user nova-compute[76161]:     </rng>
Nov 14 17:54:59 user nova-compute[76161]:   </devices>
Nov 14 17:54:59 user nova-compute[76161]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 17:54:59 user nova-compute[76161]:     <label>libvirt-b37a7f95-b429-431a-b837-a650fd1ee27e</label>
Nov 14 17:54:59 user nova-compute[76161]:     <imagelabel>libvirt-b37a7f95-b429-431a-b837-a650fd1ee27e</imagelabel>
Nov 14 17:54:59 user nova-compute[76161]:   </seclabel>
Nov 14 17:54:59 user nova-compute[76161]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 17:54:59 user nova-compute[76161]:     <label>+64055:+108</label>
Nov 14 17:54:59 user nova-compute[76161]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 17:54:59 user nova-compute[76161]:   </seclabel>
Nov 14 17:54:59 user nova-compute[76161]: </domain>
Nov 14 17:54:59 user nova-compute[76161]:  {{(pid=76161) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 17:54:59 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Successfully detached device tap3be17c85-68 from instance b37a7f95-b429-431a-b837-a650fd1ee27e from the persistent domain config.
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] (1/8): Attempting to detach device tap3be17c85-68 with device alias net1 from instance b37a7f95-b429-431a-b837-a650fd1ee27e from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] detach device xml: <interface type="ethernet">
Nov 14 17:54:59 user nova-compute[76161]:   <mac address="fa:16:3e:2e:c8:2b"/>
Nov 14 17:54:59 user nova-compute[76161]:   <model type="virtio"/>
Nov 14 17:54:59 user nova-compute[76161]:   <mtu size="1442"/>
Nov 14 17:54:59 user nova-compute[76161]:   <target dev="tap3be17c85-68"/>
Nov 14 17:54:59 user nova-compute[76161]: </interface>
Nov 14 17:54:59 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.neutron [req-9ec95c20-3275-41bb-b0b5-9cd9dd188d87 req-a78b9b17-276a-4f93-bab1-ebde15bb26a6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updated VIF entry in instance network info cache for port 69b8f81e-f7ba-4056-ba8b-5493d55616c8. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG nova.network.neutron [req-9ec95c20-3275-41bb-b0b5-9cd9dd188d87 req-a78b9b17-276a-4f93-bab1-ebde15bb26a6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updating instance_info_cache with network_info: [{"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9ec95c20-3275-41bb-b0b5-9cd9dd188d87 req-a78b9b17-276a-4f93-bab1-ebde15bb26a6 service nova] Releasing lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:54:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Start waiting for the detach event from libvirt for device tap3be17c85-68 with device alias net1 for instance b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:55:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-unplugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-unplugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:01 user nova-compute[76161]: WARNING nova.compute.manager [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-unplugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 for instance with vm_state active and task_state None.
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-plugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-plugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:01 user nova-compute[76161]: WARNING nova.compute.manager [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-plugged-3be17c85-687c-4e56-a1b8-9af5cee15ed2 for instance with vm_state active and task_state None.
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received event network-vif-plugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] No waiting events found dispatching network-vif-plugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:01 user nova-compute[76161]: WARNING nova.compute.manager [req-bd8c78b8-bcfa-4d50-859f-9a74077ec2ea req-21dfd04a-10d3-467b-b707-472b5e0734b6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received unexpected event network-vif-plugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 for instance with vm_state building and task_state spawning.
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-cb892366-acd3-4a5f-90e8-e29b1755d532 req-9c60cf9a-f486-4895-ad44-a0d59379e802 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-changed-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-cb892366-acd3-4a5f-90e8-e29b1755d532 req-9c60cf9a-f486-4895-ad44-a0d59379e802 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Refreshing instance network info cache due to event network-changed-b2487e15-e0cf-4079-9baf-f522396ce976. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cb892366-acd3-4a5f-90e8-e29b1755d532 req-9c60cf9a-f486-4895-ad44-a0d59379e802 service nova] Acquiring lock "refresh_cache-56848a92-97b3-4eef-b924-de8ab85ad115" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cb892366-acd3-4a5f-90e8-e29b1755d532 req-9c60cf9a-f486-4895-ad44-a0d59379e802 service nova] Acquired lock "refresh_cache-56848a92-97b3-4eef-b924-de8ab85ad115" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.network.neutron [req-cb892366-acd3-4a5f-90e8-e29b1755d532 req-9c60cf9a-f486-4895-ad44-a0d59379e802 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Refreshing network info cache for port b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.objects.instance [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'flavor' on Instance uuid 56848a92-97b3-4eef-b924-de8ab85ad115 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.network.neutron [req-cb892366-acd3-4a5f-90e8-e29b1755d532 req-9c60cf9a-f486-4895-ad44-a0d59379e802 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Updated VIF entry in instance network info cache for port b2487e15-e0cf-4079-9baf-f522396ce976. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG nova.network.neutron [req-cb892366-acd3-4a5f-90e8-e29b1755d532 req-9c60cf9a-f486-4895-ad44-a0d59379e802 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Updating instance_info_cache with network_info: [{"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cb892366-acd3-4a5f-90e8-e29b1755d532 req-9c60cf9a-f486-4895-ad44-a0d59379e802 service nova] Releasing lock "refresh_cache-56848a92-97b3-4eef-b924-de8ab85ad115" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:01 user nova-compute[76161]: INFO nova.compute.manager [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Attaching volume 6d8ec367-5fa5-4318-9647-605d977d3ae7 to /dev/vdb
Nov 14 17:55:01 user nova-compute[76161]: DEBUG os_brick.utils [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c080d6c-5c6f-4a40-9f4e-1a510283b42b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[825b6799-b8eb-4ce7-b739-f8202907fd96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3392bc5a-fc86-48ec-94f8-dcffcc12ee2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8704ff-cf21-48bb-85ed-489d75cbe107]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:02 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:55:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[279c2408-738a-4e2d-95ef-0f8b64b52d0b]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG os_brick.utils [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Updating existing volume attachment record: a600407b-7a47-4a64-b731-f6b0fec3c23b {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:55:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Instance spawned successfully.
Nov 14 17:55:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:03 user nova-compute[76161]: INFO nova.compute.manager [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 14 17:55:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:55:03 user nova-compute[76161]: INFO nova.compute.manager [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Took 6.33 seconds to build instance.
Nov 14 17:55:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f15e4dfd-72d0-4608-9fcf-775a986f7bf1 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.442s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-2e06bb06-36ba-48ce-82d0-16a1c06e7bf1 req-735fc57b-aa86-4a25-86b3-d48022d46b58 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received event network-vif-plugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2e06bb06-36ba-48ce-82d0-16a1c06e7bf1 req-735fc57b-aa86-4a25-86b3-d48022d46b58 service nova] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2e06bb06-36ba-48ce-82d0-16a1c06e7bf1 req-735fc57b-aa86-4a25-86b3-d48022d46b58 service nova] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2e06bb06-36ba-48ce-82d0-16a1c06e7bf1 req-735fc57b-aa86-4a25-86b3-d48022d46b58 service nova] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-2e06bb06-36ba-48ce-82d0-16a1c06e7bf1 req-735fc57b-aa86-4a25-86b3-d48022d46b58 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] No waiting events found dispatching network-vif-plugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:03 user nova-compute[76161]: WARNING nova.compute.manager [req-2e06bb06-36ba-48ce-82d0-16a1c06e7bf1 req-735fc57b-aa86-4a25-86b3-d48022d46b58 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received unexpected event network-vif-plugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 for instance with vm_state active and task_state None.
Nov 14 17:55:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Port 39b86458-3c6f-457f-b2ba-e2f4709ffb50 binding to destination host user is already ACTIVE {{(pid=76161) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 17:55:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:55:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquired lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:55:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:55:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating instance_info_cache with network_info: [{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Releasing lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:55:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Creating tmpfile /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/tmpdguyjaha to verify with other compute node that the instance is on the same shared storage. {{(pid=76161) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-cc73b2dc-cd9a-43fa-9ada-5f9124c769ca req-34eb5baa-7bd0-4ace-a610-3b1f70e5c277 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-unplugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cc73b2dc-cd9a-43fa-9ada-5f9124c769ca req-34eb5baa-7bd0-4ace-a610-3b1f70e5c277 service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cc73b2dc-cd9a-43fa-9ada-5f9124c769ca req-34eb5baa-7bd0-4ace-a610-3b1f70e5c277 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cc73b2dc-cd9a-43fa-9ada-5f9124c769ca req-34eb5baa-7bd0-4ace-a610-3b1f70e5c277 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-cc73b2dc-cd9a-43fa-9ada-5f9124c769ca req-34eb5baa-7bd0-4ace-a610-3b1f70e5c277 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-unplugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:06 user nova-compute[76161]: WARNING nova.compute.manager [req-cc73b2dc-cd9a-43fa-9ada-5f9124c769ca req-34eb5baa-7bd0-4ace-a610-3b1f70e5c277 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-unplugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state resized and task_state resize_reverting.
Nov 14 17:55:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXfclPUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:06 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:06 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:06 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52a82f4-08d5-4204-a59e-5a897def8416]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:55:06 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a33c43-7069-4b2d-b423-3e5ccc9029a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7] added
Nov 14 17:55:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d16bae-7489-46c6-af21-21386a850cbf]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7f7410-9b0e-499f-bd41-7e93836dc161]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXfclPUp {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXfclPUp" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9089b57-08a7-456d-b182-f04c3a2eaa1e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uXfclPUp'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61c910f-b976-4a17-aada-326b3f2de29d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[809ab993-3941-480d-93a3-95ee1fe23218]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:06 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:06 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance destroyed successfully.
Nov 14 17:55:06 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lazy-loading 'resources' on Instance uuid 56f47238-81fe-4196-865c-e1ad68cf6fea {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-412733385',display_name='tempest-ServerActionsTestOtherB-server-412733385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-412733385',id=4,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0NZD4kqQvyUmQDlStvq04ezcWsfIyD0A/bWacUhJpYz5fcS1f2SC6UBuTPRJ8HEnEXX6nzxYwzXvCIrkT+ksrUBvLI5jLRbrB40MHHEGW3qMOyOEwSYMvxHD0HaK5eqA==',key_name='tempest-keypair-1585564500',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d05c015b22d142de91f43f92f00fe8f5',ramdisk_id='',reservation_id='r-ixxlkxwq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2076940630',owner_user_name='tempest-ServerActionsTestOtherB-2076940630-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdcf024ba5d2481aad966acad37d9275',uuid=56f47238-81fe-4196-865c-e1ad68cf6fea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converting VIF {"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_vif [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39b86458-3c, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6500618d-f479-48db-b7a5-889a0031c87f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd8a4b06-eb82-4eca-ab97-706e480df952) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260]
Nov 14 17:55:06 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260] successful.
Nov 14 17:55:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:06 user nova-compute[76161]: INFO os_vif [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c')
Nov 14 17:55:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:06 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8bd901-f35e-4dfc-8674-aac1a8e043e2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[257db9e1-325c-4b7a-a14c-3ebc073546e6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:06 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:06 user nova-compute[76161]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:06 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:06 user nova-compute[76161]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17ad226-feea-4763-bdd5-4be303cd05f9]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:55:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXfclPUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23962663862623665', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962663862623665', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.060s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'flavor' on Instance uuid 56848a92-97b3-4eef-b924-de8ab85ad115 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b60590-3e2c-4c4b-93b5-0086e7a58277]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:55:07 user nova-compute[76161]: No targets found.
Nov 14 17:55:07 user nova-compute[76161]: iSNS:
Nov 14 17:55:07 user nova-compute[76161]: No targets found.
Nov 14 17:55:07 user nova-compute[76161]: STATIC:
Nov 14 17:55:07 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:55:07 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:55:07 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:55:07 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:55:07 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:55:07 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:55:07 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:55:07 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:55:07 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:55:07 user nova-compute[76161]: FIRMWARE:
Nov 14 17:55:07 user nova-compute[76161]: No targets found.
Nov 14 17:55:07 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:55:07 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:55:07 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:55:07 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:55:07 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 17:55:07 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:55:07 user nova-compute[76161]:   <serial>6d8ec367-5fa5-4318-9647-605d977d3ae7</serial>
Nov 14 17:55:07 user nova-compute[76161]: </disk>
Nov 14 17:55:07 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e84de0-dbf6-4852-b2cc-c5ec7d49bf89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eb0de3-ff65-4539-bcdb-51c6fc329e14]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:07 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:07 user nova-compute[76161]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:07 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:07 user nova-compute[76161]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:07 user nova-compute[76161]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:07 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f01b2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e946be-c511-4de6-9c9f-8dbf2f8d5d2d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eb47b7-4288-49ee-b074-172af8d367d5]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aba1d7-b3d5-4096-a856-d82d548e9b83]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[24779fdf-3822-40f8-adbb-e4ee54331f8e]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef89dcf-9790-4742-9179-03a8121b1087]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] There are 0 instances to clean {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aa0f9d-540d-4151-8f9d-83bc94a4aa23]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]
Nov 14 17:55:08 user nova-compute[76161]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.
Nov 14 17:55:08 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba76951-9540-4dd4-91b6-9481ea8d1eab]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] <== disconnect_volume: return (1373ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-fb91bbc8-01c2-43ec-9575-2b6b9378e010 req-69eb3c32-d54e-4c17-8ebe-7551be60cbcb service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fb91bbc8-01c2-43ec-9575-2b6b9378e010 req-69eb3c32-d54e-4c17-8ebe-7551be60cbcb service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fb91bbc8-01c2-43ec-9575-2b6b9378e010 req-69eb3c32-d54e-4c17-8ebe-7551be60cbcb service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fb91bbc8-01c2-43ec-9575-2b6b9378e010 req-69eb3c32-d54e-4c17-8ebe-7551be60cbcb service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-fb91bbc8-01c2-43ec-9575-2b6b9378e010 req-69eb3c32-d54e-4c17-8ebe-7551be60cbcb service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:08 user nova-compute[76161]: WARNING nova.compute.manager [req-fb91bbc8-01c2-43ec-9575-2b6b9378e010 req-69eb3c32-d54e-4c17-8ebe-7551be60cbcb service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state resized and task_state resize_reverting.
Nov 14 17:55:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No VIF found with MAC fa:16:3e:46:2d:e4, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:55:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-796dd68c-24f4-4716-ad77-f194c513f01a tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.608s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lazy-loading 'migration_context' on Instance uuid 56f47238-81fe-4196-865c-e1ad68cf6fea {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG nova.objects.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Object Instance<56f47238-81fe-4196-865c-e1ad68cf6fea> lazy-loaded attributes: resources,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.493s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:09 user nova-compute[76161]: INFO nova.compute.manager [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Swapping old allocation on dict_keys(['eef4e2ad-d4c6-40c7-9f76-0a052858d5fd']) held by migration bf20f369-2efa-413f-bf27-d76d1098bcf1 for instance
Nov 14 17:55:09 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Overwriting current allocation {'allocations': {'eef4e2ad-d4c6-40c7-9f76-0a052858d5fd': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 26}}, 'project_id': 'd05c015b22d142de91f43f92f00fe8f5', 'user_id': 'fdcf024ba5d2481aad966acad37d9275', 'consumer_generation': 1} on consumer 56f47238-81fe-4196-865c-e1ad68cf6fea {{(pid=76161) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquired lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:55:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76161) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 17:55:10 user nova-compute[76161]: INFO nova.compute.manager [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Rebuilding instance
Nov 14 17:55:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating instance_info_cache with network_info: [{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Releasing lock "refresh_cache-56f47238-81fe-4196-865c-e1ad68cf6fea" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG os_brick.utils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5822ee8e-ab45-40ef-85bd-eb401640b8ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7abac1-d0be-4918-8058-bda01ca84d83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b10ba-f910-4a3a-b425-828fb3f44a3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb763cd-4c89-4812-9d99-11fa7c82e831]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-137ba143-1b09-4065-8e7f-fda79d6cd3e9 req-dde4d944-8e51-410d-9ca0-f3f0460d8765 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-vif-unplugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-137ba143-1b09-4065-8e7f-fda79d6cd3e9 req-dde4d944-8e51-410d-9ca0-f3f0460d8765 service nova] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-137ba143-1b09-4065-8e7f-fda79d6cd3e9 req-dde4d944-8e51-410d-9ca0-f3f0460d8765 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-137ba143-1b09-4065-8e7f-fda79d6cd3e9 req-dde4d944-8e51-410d-9ca0-f3f0460d8765 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-137ba143-1b09-4065-8e7f-fda79d6cd3e9 req-dde4d944-8e51-410d-9ca0-f3f0460d8765 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] No waiting events found dispatching network-vif-unplugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:10 user nova-compute[76161]: WARNING nova.compute.manager [req-137ba143-1b09-4065-8e7f-fda79d6cd3e9 req-dde4d944-8e51-410d-9ca0-f3f0460d8765 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received unexpected event network-vif-unplugged-b2487e15-e0cf-4079-9baf-f522396ce976 for instance with vm_state active and task_state rebuilding.
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:10 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:55:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aed4410-8776-4e14-bcc5-b5dfcc04cb59]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:55:10 user nova-compute[76161]: DEBUG os_brick.utils [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Instance destroyed successfully.
Nov 14 17:55:11 user nova-compute[76161]: INFO nova.compute.manager [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Detaching volume 6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:55:11 user nova-compute[76161]: INFO nova.virt.block_device [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Attempting to driver detach volume 6d8ec367-5fa5-4318-9647-605d977d3ae7 from mountpoint /dev/vdb
Nov 14 17:55:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Attempting to detach device vdb from instance 56848a92-97b3-4eef-b924-de8ab85ad115 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:55:11 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:55:11 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 17:55:11 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:55:11 user nova-compute[76161]:   <serial>6d8ec367-5fa5-4318-9647-605d977d3ae7</serial>
Nov 14 17:55:11 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:55:11 user nova-compute[76161]: </disk>
Nov 14 17:55:11 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:55:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully detached device vdb from instance 56848a92-97b3-4eef-b924-de8ab85ad115 from the persistent domain config.
Nov 14 17:55:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXfclPUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:11 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5309efb6-63a2-46a2-b7be-13bb3be0c8f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:55:11 user nova-compute[76161]: No targets found.
Nov 14 17:55:11 user nova-compute[76161]: iSNS:
Nov 14 17:55:11 user nova-compute[76161]: No targets found.
Nov 14 17:55:11 user nova-compute[76161]: STATIC:
Nov 14 17:55:11 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:55:11 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:55:11 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:55:11 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:55:11 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:55:11 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:55:11 user nova-compute[76161]: FIRMWARE:
Nov 14 17:55:11 user nova-compute[76161]: No targets found.
Nov 14 17:55:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:55:11 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:55:11 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6dcb54-b2d1-4d95-a4e3-e3cb38d194d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ce09ff-ccce-4b9a-b5d1-3aa071076f1a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:11 user nova-compute[76161]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:11 user nova-compute[76161]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0128af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2404756-b0f7-4e14-961c-4e58d767721d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc0170-1ee2-4faa-a821-94a367c8565f]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f52e006-3dcf-4d29-b150-3bc356284108]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedbc6f5-7099-4131-ae51-5ea1194690d2]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0ead84-a51d-4a80-935f-3735b3d7dcfd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b4c9f-a11f-479e-82b9-66a984fed668]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260]
Nov 14 17:55:11 user nova-compute[76161]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260] successful.
Nov 14 17:55:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "678e458a-aeb6-4f29-b20b-74115179025f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "678e458a-aeb6-4f29-b20b-74115179025f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:11 user nova-compute[76161]: INFO nova.compute.manager [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Terminating instance
Nov 14 17:55:11 user nova-compute[76161]: DEBUG nova.compute.manager [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56f1963-92a2-4eba-a863-d6ac97823436]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== disconnect_volume: return (320ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-9258a265-a5e8-4810-8c4a-87adda23e8de req-71b66e34-5e86-458c-896f-ee46dacf0f33 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received event network-vif-unplugged-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9258a265-a5e8-4810-8c4a-87adda23e8de req-71b66e34-5e86-458c-896f-ee46dacf0f33 service nova] Acquiring lock "678e458a-aeb6-4f29-b20b-74115179025f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9258a265-a5e8-4810-8c4a-87adda23e8de req-71b66e34-5e86-458c-896f-ee46dacf0f33 service nova] Lock "678e458a-aeb6-4f29-b20b-74115179025f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9258a265-a5e8-4810-8c4a-87adda23e8de req-71b66e34-5e86-458c-896f-ee46dacf0f33 service nova] Lock "678e458a-aeb6-4f29-b20b-74115179025f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-9258a265-a5e8-4810-8c4a-87adda23e8de req-71b66e34-5e86-458c-896f-ee46dacf0f33 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] No waiting events found dispatching network-vif-unplugged-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-9258a265-a5e8-4810-8c4a-87adda23e8de req-71b66e34-5e86-458c-896f-ee46dacf0f33 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received event network-vif-unplugged-1441c480-e1b4-4233-a76c-d8de659dc72e for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:55:12 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Instance destroyed successfully.
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.objects.instance [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lazy-loading 'resources' on Instance uuid 678e458a-aeb6-4f29-b20b-74115179025f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1489951604',display_name='tempest-VolumesAdminNegativeTest-server-1489951604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1489951604',id=6,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsvUjZJYFeWB3CyrHlPoqE6a5WZ2VH43q9l7Beo5aHaw/xDGA/tDlJMbNoc6lAtbPiwg/phxP3y/ViqsUN7oHuh2hnzbAyxPbBTrMcBthBb6MFVXb7vnTV6iJU9vhUFCg==',key_name='tempest-keypair-353030206',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c734a545ba17409c812203610ba23ab9',ramdisk_id='',reservation_id='r-jjvz35pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-826340027',owner_user_name='tempest-VolumesAdminNegativeTest-826340027-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce9768ac5fdb4774874128973d9e7b35',uuid=678e458a-aeb6-4f29-b20b-74115179025f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converting VIF {"id": "1441c480-e1b4-4233-a76c-d8de659dc72e", "address": "fa:16:3e:dc:63:3e", "network": {"id": "b9b09899-ca1d-40dc-99d0-28912ce4d501", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-40100475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c734a545ba17409c812203610ba23ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1441c480-e1", "ovs_interfaceid": "1441c480-e1b4-4233-a76c-d8de659dc72e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=1441c480-e1b4-4233-a76c-d8de659dc72e,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1441c480-e1') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_vif [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=1441c480-e1b4-4233-a76c-d8de659dc72e,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1441c480-e1') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1441c480-e1, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a70b818-0caf-42d6-8794-bfd64aad1ffa) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:12 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Instance destroyed successfully.
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1095895513',display_name='tempest-ServerActionsTestOtherA-server-1304251250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1095895513',id=17,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnUVlrrKY796M2WQb0to34mVHtH8sawDJDiNWfGFXurDBDBklAQgDqd8pjjgIb+0Unj5c6grIFHGUanM3AOdi9gBLjHVsWn12jK6zqkIeGTVVB8fkRDE79sNBqkLYZt1g==',key_name='tempest-keypair-916935358',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:53:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-byfwoe9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=56848a92-97b3-4eef-b924-de8ab85ad115,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_vif [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2487e15-e0, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: INFO os_vif [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=1441c480-e1b4-4233-a76c-d8de659dc72e,network=Network(b9b09899-ca1d-40dc-99d0-28912ce4d501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1441c480-e1')
Nov 14 17:55:12 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Deleting instance files /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f_del
Nov 14 17:55:12 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Deletion of /opt/stack/data/nova/instances/678e458a-aeb6-4f29-b20b-74115179025f_del complete
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8e202e8-719a-49ca-a0b7-1feb5b2bec31) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:12 user nova-compute[76161]: INFO os_vif [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0')
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXfclPUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:12 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaefd11a-ca7a-43a6-adb4-22aa302a5bde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:55:12 user nova-compute[76161]: No targets found.
Nov 14 17:55:12 user nova-compute[76161]: iSNS:
Nov 14 17:55:12 user nova-compute[76161]: No targets found.
Nov 14 17:55:12 user nova-compute[76161]: STATIC:
Nov 14 17:55:12 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:55:12 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:55:12 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:55:12 user nova-compute[76161]: FIRMWARE:
Nov 14 17:55:12 user nova-compute[76161]: No targets found.
Nov 14 17:55:12 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:55:12 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:55:12 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:12 user nova-compute[76161]: INFO nova.compute.manager [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4e1dac-720e-432d-972a-fa23bdc15a43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2575988-d35f-4e27-b225-51199121262b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:12 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:12 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0129750>, {}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Disconnecting from: [] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== disconnect_volume: return (84ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:55:12 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Deleting instance files /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115_del
Nov 14 17:55:12 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Deletion of /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115_del complete
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-69296513-d579-4bc7-9cf4-2bb80e43b1eb req-62f34554-119e-46fa-86ac-c332a6838f82 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-69296513-d579-4bc7-9cf4-2bb80e43b1eb req-62f34554-119e-46fa-86ac-c332a6838f82 service nova] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-69296513-d579-4bc7-9cf4-2bb80e43b1eb req-62f34554-119e-46fa-86ac-c332a6838f82 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-69296513-d579-4bc7-9cf4-2bb80e43b1eb req-62f34554-119e-46fa-86ac-c332a6838f82 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-69296513-d579-4bc7-9cf4-2bb80e43b1eb req-62f34554-119e-46fa-86ac-c332a6838f82 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] No waiting events found dispatching network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:12 user nova-compute[76161]: WARNING nova.compute.manager [req-69296513-d579-4bc7-9cf4-2bb80e43b1eb req-62f34554-119e-46fa-86ac-c332a6838f82 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received unexpected event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 for instance with vm_state active and task_state rebuilding.
Nov 14 17:55:12 user nova-compute[76161]: INFO nova.virt.block_device [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Booting with volume 6d8ec367-5fa5-4318-9647-605d977d3ae7 at /dev/vdb
Nov 14 17:55:13 user nova-compute[76161]: DEBUG os_brick.utils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1e8464-57d3-40f1-a12d-6218951192db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[02012f82-ebe8-4cbf-b95e-019c10cae039]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e21116b-5f25-4bb6-947c-b413ff81ea28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed99c035-2711-4ce1-8daf-8a11e21eb88c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:13 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[be21a25b-6578-47d5-9cc0-3d6feb3101ce]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG os_brick.utils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Updating existing volume attachment record: 378bac1c-afb4-4d4b-a42f-8d3765d700b8 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-18ca01ca-5f8f-4dc4-a7f2-f54f3c1c88a1 req-5c145dca-3ca0-4178-8488-fcb64056b8eb service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received event network-vif-deleted-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:13 user nova-compute[76161]: INFO nova.compute.manager [req-18ca01ca-5f8f-4dc4-a7f2-f54f3c1c88a1 req-5c145dca-3ca0-4178-8488-fcb64056b8eb service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Neutron deleted interface 1441c480-e1b4-4233-a76c-d8de659dc72e; detaching it from the instance and deleting it from the info cache
Nov 14 17:55:13 user nova-compute[76161]: DEBUG nova.network.neutron [req-18ca01ca-5f8f-4dc4-a7f2-f54f3c1c88a1 req-5c145dca-3ca0-4178-8488-fcb64056b8eb service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:13 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Took 0.79 seconds to deallocate network for instance.
Nov 14 17:55:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-18ca01ca-5f8f-4dc4-a7f2-f54f3c1c88a1 req-5c145dca-3ca0-4178-8488-fcb64056b8eb service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Detach interface failed, port_id=1441c480-e1b4-4233-a76c-d8de659dc72e, reason: Instance 678e458a-aeb6-4f29-b20b-74115179025f could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:13 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Refreshing inventories for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Updating ProviderTree inventory for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Refreshing aggregate associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, aggregates: None {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Refreshing trait associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received event network-vif-plugged-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] Acquiring lock "678e458a-aeb6-4f29-b20b-74115179025f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] Lock "678e458a-aeb6-4f29-b20b-74115179025f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] Lock "678e458a-aeb6-4f29-b20b-74115179025f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] No waiting events found dispatching network-vif-plugged-1441c480-e1b4-4233-a76c-d8de659dc72e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:14 user nova-compute[76161]: WARNING nova.compute.manager [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] [instance: 678e458a-aeb6-4f29-b20b-74115179025f] Received unexpected event network-vif-plugged-1441c480-e1b4-4233-a76c-d8de659dc72e for instance with vm_state deleted and task_state None.
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Received event network-changed-d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Refreshing instance network info cache due to event network-changed-d87d00b4-392b-4b9d-8fb3-20c3dfe59894. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] Acquiring lock "refresh_cache-76193048-410d-4a59-9eb5-165d8ce0af6c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] Acquired lock "refresh_cache-76193048-410d-4a59-9eb5-165d8ce0af6c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Refreshing network info cache for port d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.675s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:14 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Deleted allocations for instance 678e458a-aeb6-4f29-b20b-74115179025f
Nov 14 17:55:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-13eae066-7789-4aa7-898b-b0c5759960d3 tempest-VolumesAdminNegativeTest-826340027 tempest-VolumesAdminNegativeTest-826340027-project-member] Lock "678e458a-aeb6-4f29-b20b-74115179025f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Updated VIF entry in instance network info cache for port d87d00b4-392b-4b9d-8fb3-20c3dfe59894. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Updating instance_info_cache with network_info: [{"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f5ae1cf-d964-4f67-b1de-076eb102112c req-084541cd-796d-46ca-81df-4877ca1f4363 service nova] Releasing lock "refresh_cache-76193048-410d-4a59-9eb5-165d8ce0af6c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:55:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "76193048-410d-4a59-9eb5-165d8ce0af6c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'flavor' on Instance uuid 76193048-410d-4a59-9eb5-165d8ce0af6c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Starting finish_revert_migration {{(pid=76161) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Start _get_guest_xml network_info=[{"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '56f47238-81fe-4196-865c-e1ad68cf6fea', 'attached_at': '2023-11-14T17:55:15.000000', 'detached_at': '', 'volume_id': 'd96c39a9-1a04-42d8-8ae6-7738ced041a1', 'serial': 'd96c39a9-1a04-42d8-8ae6-7738ced041a1'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '533296df-8567-4f99-b323-8e89b84787c3', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:55:15 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:55:15 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lazy-loading 'vcpu_model' on Instance uuid 56f47238-81fe-4196-865c-e1ad68cf6fea {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:15 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:15 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:15 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "76193048-410d-4a59-9eb5-165d8ce0af6c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:15 user nova-compute[76161]: INFO nova.compute.manager [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Attaching volume ed314789-1cd9-44ce-bd41-d54d6db6a8f8 to /dev/vdb
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a9524b-34c7-47ef-96b3-3f63f7ed3be3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:55:15 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c6cd32-1b6b-4fb5-a793-24b31583f9fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1] added
Nov 14 17:55:15 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faad90f-889d-4999-b065-fc2e35e4e947]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.utils [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45f59fe-c013-46e2-a5ee-491bfdf11309]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgBeLnrW {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b392f64f-d6af-4e6b-b7c6-1ca54ba51fc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgBeLnrW" returned: 0 in 0.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c38c3c4-796a-4217-85b7-2bdd9731a3d4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgBeLnrW'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.037s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe0b6c-d11c-442f-b7aa-38f6dcd68a4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c59b51-01a2-4451-81ec-df95a21a1665]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c064768-78d7-4149-b6bf-55ce94d8c89f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21c830c-05c6-4a14-91a6-bfdc5d3edf1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a9a0f2-6947-441e-8e10-009cbe92cca1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:15 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:15 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:15 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67615ec-c5a5-4a72-89c8-892e14730961]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.utils [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Updating existing volume attachment record: bcbfe659-226f-451d-a185-29a24b4fbd3b {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3627a42-a5c2-4b80-9ad3-e4786e661e8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]
Nov 14 17:55:15 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.
Nov 14 17:55:15 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[378021a1-8296-4193-9232-74346616e74b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff0a588-bb72-4730-8e2b-b7ec919bed7c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:15 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:15 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:15 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:15 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3925eb-c3aa-4ea6-9504-5dc7992282c2]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:55:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23334346433653232', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334346433653232', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-412733385',display_name='tempest-ServerActionsTestOtherB-server-412733385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-412733385',id=4,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0NZD4kqQvyUmQDlStvq04ezcWsfIyD0A/bWacUhJpYz5fcS1f2SC6UBuTPRJ8HEnEXX6nzxYwzXvCIrkT+ksrUBvLI5jLRbrB40MHHEGW3qMOyOEwSYMvxHD0HaK5eqA==',key_name='tempest-keypair-1585564500',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d05c015b22d142de91f43f92f00fe8f5',ramdisk_id='',reservation_id='r-ixxlkxwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2076940630',owner_user_name='tempest-ServerActionsTestOtherB-2076940630-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:55:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdcf024ba5d2481aad966acad37d9275',uuid=56f47238-81fe-4196-865c-e1ad68cf6fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converting VIF {"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:55:16 user nova-compute[76161]:   <uuid>56f47238-81fe-4196-865c-e1ad68cf6fea</uuid>
Nov 14 17:55:16 user nova-compute[76161]:   <name>instance-00000004</name>
Nov 14 17:55:16 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:55:16 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:55:16 user nova-compute[76161]:   <metadata>
Nov 14 17:55:16 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:55:16 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:55:16 user nova-compute[76161]:       <nova:name>tempest-ServerActionsTestOtherB-server-412733385</nova:name>
Nov 14 17:55:16 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:55:15</nova:creationTime>
Nov 14 17:55:16 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:55:16 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:55:16 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:55:16 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:55:16 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:55:16 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:55:16 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:55:16 user nova-compute[76161]:       <nova:owner>
Nov 14 17:55:16 user nova-compute[76161]:         <nova:user uuid="fdcf024ba5d2481aad966acad37d9275">tempest-ServerActionsTestOtherB-2076940630-project-member</nova:user>
Nov 14 17:55:16 user nova-compute[76161]:         <nova:project uuid="d05c015b22d142de91f43f92f00fe8f5">tempest-ServerActionsTestOtherB-2076940630</nova:project>
Nov 14 17:55:16 user nova-compute[76161]:       </nova:owner>
Nov 14 17:55:16 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:55:16 user nova-compute[76161]:       <nova:ports>
Nov 14 17:55:16 user nova-compute[76161]:         <nova:port uuid="39b86458-3c6f-457f-b2ba-e2f4709ffb50">
Nov 14 17:55:16 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 17:55:16 user nova-compute[76161]:         </nova:port>
Nov 14 17:55:16 user nova-compute[76161]:       </nova:ports>
Nov 14 17:55:16 user nova-compute[76161]:     </nova:instance>
Nov 14 17:55:16 user nova-compute[76161]:   </metadata>
Nov 14 17:55:16 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:55:16 user nova-compute[76161]:     <system>
Nov 14 17:55:16 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:55:16 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:55:16 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:55:16 user nova-compute[76161]:       <entry name="serial">56f47238-81fe-4196-865c-e1ad68cf6fea</entry>
Nov 14 17:55:16 user nova-compute[76161]:       <entry name="uuid">56f47238-81fe-4196-865c-e1ad68cf6fea</entry>
Nov 14 17:55:16 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:55:16 user nova-compute[76161]:     </system>
Nov 14 17:55:16 user nova-compute[76161]:   </sysinfo>
Nov 14 17:55:16 user nova-compute[76161]:   <os>
Nov 14 17:55:16 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:55:16 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:55:16 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:55:16 user nova-compute[76161]:   </os>
Nov 14 17:55:16 user nova-compute[76161]:   <features>
Nov 14 17:55:16 user nova-compute[76161]:     <acpi/>
Nov 14 17:55:16 user nova-compute[76161]:     <apic/>
Nov 14 17:55:16 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:55:16 user nova-compute[76161]:   </features>
Nov 14 17:55:16 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:55:16 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:55:16 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:55:16 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:55:16 user nova-compute[76161]:   </clock>
Nov 14 17:55:16 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:55:16 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:55:16 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:55:16 user nova-compute[76161]:   </cpu>
Nov 14 17:55:16 user nova-compute[76161]:   <devices>
Nov 14 17:55:16 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:55:16 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:55:16 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk"/>
Nov 14 17:55:16 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:55:16 user nova-compute[76161]:     </disk>
Nov 14 17:55:16 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:55:16 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:55:16 user nova-compute[76161]:       <source dev="/dev/sdb"/>
Nov 14 17:55:16 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 17:55:16 user nova-compute[76161]:       <serial>d96c39a9-1a04-42d8-8ae6-7738ced041a1</serial>
Nov 14 17:55:16 user nova-compute[76161]:     </disk>
Nov 14 17:55:16 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:55:16 user nova-compute[76161]:       <mac address="fa:16:3e:27:c8:17"/>
Nov 14 17:55:16 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:55:16 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:55:16 user nova-compute[76161]:       <target dev="tap39b86458-3c"/>
Nov 14 17:55:16 user nova-compute[76161]:     </interface>
Nov 14 17:55:16 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:55:16 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/console.log" append="off"/>
Nov 14 17:55:16 user nova-compute[76161]:     </serial>
Nov 14 17:55:16 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:55:16 user nova-compute[76161]:     <video>
Nov 14 17:55:16 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:55:16 user nova-compute[76161]:     </video>
Nov 14 17:55:16 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:55:16 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:55:16 user nova-compute[76161]:     </rng>
Nov 14 17:55:16 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:55:16 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:55:16 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:55:16 user nova-compute[76161]:     </memballoon>
Nov 14 17:55:16 user nova-compute[76161]:   </devices>
Nov 14 17:55:16 user nova-compute[76161]: </domain>
Nov 14 17:55:16 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-412733385',display_name='tempest-ServerActionsTestOtherB-server-412733385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-412733385',id=4,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0NZD4kqQvyUmQDlStvq04ezcWsfIyD0A/bWacUhJpYz5fcS1f2SC6UBuTPRJ8HEnEXX6nzxYwzXvCIrkT+ksrUBvLI5jLRbrB40MHHEGW3qMOyOEwSYMvxHD0HaK5eqA==',key_name='tempest-keypair-1585564500',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d05c015b22d142de91f43f92f00fe8f5',ramdisk_id='',reservation_id='r-ixxlkxwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2076940630',owner_user_name='tempest-ServerActionsTestOtherB-2076940630-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:55:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdcf024ba5d2481aad966acad37d9275',uuid=56f47238-81fe-4196-865c-e1ad68cf6fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converting VIF {"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG os_vif [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82001577-839c-52ad-839d-3a9eb403b664', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39b86458-3c, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39b86458-3c, col_values=(('qos', UUID('65dd35f4-9e7b-4406-bfdc-5922228bf7d1')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39b86458-3c, col_values=(('external_ids', {'iface-id': '39b86458-3c6f-457f-b2ba-e2f4709ffb50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:c8:17', 'vm-uuid': '56f47238-81fe-4196-865c-e1ad68cf6fea'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:17 user nova-compute[76161]: INFO os_vif [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c')
Nov 14 17:55:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:55:18 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Creating image(s)
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "/opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "/opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "/opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk 1073741824" returned: 0 in 0.052s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-01f89149-137f-450f-b804-c1efe033e8e9 req-584fe875-96da-437a-baa0-1bb85127ae7e service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-01f89149-137f-450f-b804-c1efe033e8e9 req-584fe875-96da-437a-baa0-1bb85127ae7e service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-01f89149-137f-450f-b804-c1efe033e8e9 req-584fe875-96da-437a-baa0-1bb85127ae7e service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-01f89149-137f-450f-b804-c1efe033e8e9 req-584fe875-96da-437a-baa0-1bb85127ae7e service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-01f89149-137f-450f-b804-c1efe033e8e9 req-584fe875-96da-437a-baa0-1bb85127ae7e service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:18 user nova-compute[76161]: WARNING nova.compute.manager [req-01f89149-137f-450f-b804-c1efe033e8e9 req-584fe875-96da-437a-baa0-1bb85127ae7e service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state resized and task_state resize_reverting.
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.226s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Cannot resize image /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Ensure instance console log exists: /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Start _get_guest_xml network_info=[{"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXfclPUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56848a92-97b3-4eef-b924-de8ab85ad115', 'attached_at': '', 'detached_at': '', 'volume_id': '6d8ec367-5fa5-4318-9647-605d977d3ae7', 'serial': '6d8ec367-5fa5-4318-9647-605d977d3ae7'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '378bac1c-afb4-4d4b-a42f-8d3765d700b8', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:55:18 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 17:55:18 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:55:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'vcpu_model' on Instance uuid 56848a92-97b3-4eef-b924-de8ab85ad115 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXfclPUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:19 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:19 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:19 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:55:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7678ef-e33f-4285-87f5-1fe9f277a1ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:55:19 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d02d2c8-98ad-41d4-9366-b3a89147e2e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7] added
Nov 14 17:55:19 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a19478-24c7-4d2a-bf4e-f6ca9062fc13]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d99e72-d762-4a2c-a8b4-480a15aec226]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXfclPUp {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXfclPUp" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbc0761-5be9-417d-aa3d-611b4ec16f1f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uXfclPUp'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[de46b536-8efa-4717-9883-93cb64b7324f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee48c140-630f-4988-951e-2c82fd3630b3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:19 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:19 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:19 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:19 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5805984c-69e6-498a-8cb0-ce75c68de701]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260]
Nov 14 17:55:19 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260] successful.
Nov 14 17:55:19 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f36c609-9d68-4438-a73c-fef228168502]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68f7175-573c-4831-9e94-b446540c28a5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:19 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:19 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:19 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:19 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:19 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:19 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c823655d-0ecd-40c7-a333-85a4d86fc04e]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXfclPUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:20 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Waiting for libvirt event about the detach of device tap3be17c85-68 with device alias net1 from instance b37a7f95-b429-431a-b837-a650fd1ee27e is timed out.
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2e:c8:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3be17c85-68"/></interface> {{(pid=76161) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2e:c8:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3be17c85-68"/></interface>not found in domain: <domain type='kvm' id='17'>
Nov 14 17:55:20 user nova-compute[76161]:   <name>instance-00000010</name>
Nov 14 17:55:20 user nova-compute[76161]:   <uuid>b37a7f95-b429-431a-b837-a650fd1ee27e</uuid>
Nov 14 17:55:20 user nova-compute[76161]:   <metadata>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:55:20 user nova-compute[76161]:   <nova:package version="0.0.0"/>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:name>tempest-device-tagging-server-235698834</nova:name>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:creationTime>2023-11-14 17:54:28</nova:creationTime>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:flavor name="m1.tiny">
Nov 14 17:55:20 user nova-compute[76161]:     <nova:memory>512</nova:memory>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:disk>1</nova:disk>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:swap>0</nova:swap>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:vcpus>1</nova:vcpus>
Nov 14 17:55:20 user nova-compute[76161]:   </nova:flavor>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:owner>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:user uuid="1f77ddf30c3a4891991fd2bb6e95b297">tempest-TaggedAttachmentsTest-894639612-project-member</nova:user>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:project uuid="3b442ba233de4096a5e0fa2e04d0853f">tempest-TaggedAttachmentsTest-894639612</nova:project>
Nov 14 17:55:20 user nova-compute[76161]:   </nova:owner>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:ports>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:port uuid="efc2c7fd-10f7-4ecc-a87d-c2f0c010d992">
Nov 14 17:55:20 user nova-compute[76161]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:55:20 user nova-compute[76161]:     </nova:port>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:port uuid="3be17c85-687c-4e56-a1b8-9af5cee15ed2">
Nov 14 17:55:20 user nova-compute[76161]:       <nova:ip type="fixed" address="10.10.10.111" ipVersion="4"/>
Nov 14 17:55:20 user nova-compute[76161]:     </nova:port>
Nov 14 17:55:20 user nova-compute[76161]:   </nova:ports>
Nov 14 17:55:20 user nova-compute[76161]: </nova:instance>
Nov 14 17:55:20 user nova-compute[76161]:   </metadata>
Nov 14 17:55:20 user nova-compute[76161]:   <memory unit='KiB'>524288</memory>
Nov 14 17:55:20 user nova-compute[76161]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 17:55:20 user nova-compute[76161]:   <vcpu placement='static'>1</vcpu>
Nov 14 17:55:20 user nova-compute[76161]:   <resource>
Nov 14 17:55:20 user nova-compute[76161]:     <partition>/machine</partition>
Nov 14 17:55:20 user nova-compute[76161]:   </resource>
Nov 14 17:55:20 user nova-compute[76161]:   <sysinfo type='smbios'>
Nov 14 17:55:20 user nova-compute[76161]:     <system>
Nov 14 17:55:20 user nova-compute[76161]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 17:55:20 user nova-compute[76161]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 17:55:20 user nova-compute[76161]:       <entry name='version'>0.0.0</entry>
Nov 14 17:55:20 user nova-compute[76161]:       <entry name='serial'>b37a7f95-b429-431a-b837-a650fd1ee27e</entry>
Nov 14 17:55:20 user nova-compute[76161]:       <entry name='uuid'>b37a7f95-b429-431a-b837-a650fd1ee27e</entry>
Nov 14 17:55:20 user nova-compute[76161]:       <entry name='family'>Virtual Machine</entry>
Nov 14 17:55:20 user nova-compute[76161]:     </system>
Nov 14 17:55:20 user nova-compute[76161]:   </sysinfo>
Nov 14 17:55:20 user nova-compute[76161]:   <os>
Nov 14 17:55:20 user nova-compute[76161]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 17:55:20 user nova-compute[76161]:     <boot dev='hd'/>
Nov 14 17:55:20 user nova-compute[76161]:     <smbios mode='sysinfo'/>
Nov 14 17:55:20 user nova-compute[76161]:   </os>
Nov 14 17:55:20 user nova-compute[76161]:   <features>
Nov 14 17:55:20 user nova-compute[76161]:     <acpi/>
Nov 14 17:55:20 user nova-compute[76161]:     <apic/>
Nov 14 17:55:20 user nova-compute[76161]:     <vmcoreinfo state='on'/>
Nov 14 17:55:20 user nova-compute[76161]:   </features>
Nov 14 17:55:20 user nova-compute[76161]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 17:55:20 user nova-compute[76161]:     <model fallback='forbid'>Nehalem</model>
Nov 14 17:55:20 user nova-compute[76161]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 17:55:20 user nova-compute[76161]:     <feature policy='require' name='vme'/>
Nov 14 17:55:20 user nova-compute[76161]:     <feature policy='require' name='x2apic'/>
Nov 14 17:55:20 user nova-compute[76161]:     <feature policy='require' name='hypervisor'/>
Nov 14 17:55:20 user nova-compute[76161]:   </cpu>
Nov 14 17:55:20 user nova-compute[76161]:   <clock offset='utc'>
Nov 14 17:55:20 user nova-compute[76161]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 17:55:20 user nova-compute[76161]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 17:55:20 user nova-compute[76161]:     <timer name='hpet' present='no'/>
Nov 14 17:55:20 user nova-compute[76161]:   </clock>
Nov 14 17:55:20 user nova-compute[76161]:   <on_poweroff>destroy</on_poweroff>
Nov 14 17:55:20 user nova-compute[76161]:   <on_reboot>restart</on_reboot>
Nov 14 17:55:20 user nova-compute[76161]:   <on_crash>destroy</on_crash>
Nov 14 17:55:20 user nova-compute[76161]:   <devices>
Nov 14 17:55:20 user nova-compute[76161]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 17:55:20 user nova-compute[76161]:     <disk type='file' device='disk'>
Nov 14 17:55:20 user nova-compute[76161]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 17:55:20 user nova-compute[76161]:       <source file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk' index='2'/>
Nov 14 17:55:20 user nova-compute[76161]:       <backingStore type='file' index='3'>
Nov 14 17:55:20 user nova-compute[76161]:         <format type='raw'/>
Nov 14 17:55:20 user nova-compute[76161]:         <source file='/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d'/>
Nov 14 17:55:20 user nova-compute[76161]:         <backingStore/>
Nov 14 17:55:20 user nova-compute[76161]:       </backingStore>
Nov 14 17:55:20 user nova-compute[76161]:       <target dev='vda' bus='virtio'/>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='virtio-disk0'/>
Nov 14 17:55:20 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </disk>
Nov 14 17:55:20 user nova-compute[76161]:     <disk type='file' device='cdrom'>
Nov 14 17:55:20 user nova-compute[76161]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 17:55:20 user nova-compute[76161]:       <source file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.config' index='1'/>
Nov 14 17:55:20 user nova-compute[76161]:       <backingStore/>
Nov 14 17:55:20 user nova-compute[76161]:       <target dev='hda' bus='ide'/>
Nov 14 17:55:20 user nova-compute[76161]:       <readonly/>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='ide0-0-0'/>
Nov 14 17:55:20 user nova-compute[76161]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </disk>
Nov 14 17:55:20 user nova-compute[76161]:     <controller type='usb' index='0' model='none'>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='usb'/>
Nov 14 17:55:20 user nova-compute[76161]:     </controller>
Nov 14 17:55:20 user nova-compute[76161]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='pci.0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </controller>
Nov 14 17:55:20 user nova-compute[76161]:     <controller type='ide' index='0'>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='ide'/>
Nov 14 17:55:20 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 17:55:20 user nova-compute[76161]:     </controller>
Nov 14 17:55:20 user nova-compute[76161]:     <interface type='ethernet'>
Nov 14 17:55:20 user nova-compute[76161]:       <mac address='fa:16:3e:9d:da:2c'/>
Nov 14 17:55:20 user nova-compute[76161]:       <target dev='tapefc2c7fd-10'/>
Nov 14 17:55:20 user nova-compute[76161]:       <model type='virtio'/>
Nov 14 17:55:20 user nova-compute[76161]:       <mtu size='1442'/>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='net0'/>
Nov 14 17:55:20 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </interface>
Nov 14 17:55:20 user nova-compute[76161]:     <serial type='pty'>
Nov 14 17:55:20 user nova-compute[76161]:       <source path='/dev/pts/7'/>
Nov 14 17:55:20 user nova-compute[76161]:       <log file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/console.log' append='off'/>
Nov 14 17:55:20 user nova-compute[76161]:       <target type='isa-serial' port='0'>
Nov 14 17:55:20 user nova-compute[76161]:         <model name='isa-serial'/>
Nov 14 17:55:20 user nova-compute[76161]:       </target>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='serial0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </serial>
Nov 14 17:55:20 user nova-compute[76161]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 17:55:20 user nova-compute[76161]:       <source path='/dev/pts/7'/>
Nov 14 17:55:20 user nova-compute[76161]:       <log file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/console.log' append='off'/>
Nov 14 17:55:20 user nova-compute[76161]:       <target type='serial' port='0'/>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='serial0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </console>
Nov 14 17:55:20 user nova-compute[76161]:     <input type='mouse' bus='ps2'>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='input0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </input>
Nov 14 17:55:20 user nova-compute[76161]:     <input type='keyboard' bus='ps2'>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='input1'/>
Nov 14 17:55:20 user nova-compute[76161]:     </input>
Nov 14 17:55:20 user nova-compute[76161]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Nov 14 17:55:20 user nova-compute[76161]:       <listen type='address' address='0.0.0.0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </graphics>
Nov 14 17:55:20 user nova-compute[76161]:     <audio id='1' type='none'/>
Nov 14 17:55:20 user nova-compute[76161]:     <video>
Nov 14 17:55:20 user nova-compute[76161]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='video0'/>
Nov 14 17:55:20 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </video>
Nov 14 17:55:20 user nova-compute[76161]:     <memballoon model='virtio'>
Nov 14 17:55:20 user nova-compute[76161]:       <stats period='10'/>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='balloon0'/>
Nov 14 17:55:20 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </memballoon>
Nov 14 17:55:20 user nova-compute[76161]:     <rng model='virtio'>
Nov 14 17:55:20 user nova-compute[76161]:       <backend model='random'>/dev/urandom</backend>
Nov 14 17:55:20 user nova-compute[76161]:       <alias name='rng0'/>
Nov 14 17:55:20 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 17:55:20 user nova-compute[76161]:     </rng>
Nov 14 17:55:20 user nova-compute[76161]:   </devices>
Nov 14 17:55:20 user nova-compute[76161]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 17:55:20 user nova-compute[76161]:     <label>libvirt-b37a7f95-b429-431a-b837-a650fd1ee27e</label>
Nov 14 17:55:20 user nova-compute[76161]:     <imagelabel>libvirt-b37a7f95-b429-431a-b837-a650fd1ee27e</imagelabel>
Nov 14 17:55:20 user nova-compute[76161]:   </seclabel>
Nov 14 17:55:20 user nova-compute[76161]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 17:55:20 user nova-compute[76161]:     <label>+64055:+108</label>
Nov 14 17:55:20 user nova-compute[76161]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 17:55:20 user nova-compute[76161]:   </seclabel>
Nov 14 17:55:20 user nova-compute[76161]: </domain>
Nov 14 17:55:20 user nova-compute[76161]:  {{(pid=76161) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 17:55:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Successfully detached device tap3be17c85-68 from instance b37a7f95-b429-431a-b837-a650fd1ee27e from the live domain config.
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235698834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235698834',id=16,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL15D+kMQspaKeW7+Bx5Dn7IFwRs/JMwFGq2/FmaQr23P9jWrQHvM1225hzBmTZF7rA/Hf1M98y9sJNaTlvjxHJCuE4gTpn+otFGMWDM/pMcafW1YhRqWDPdGRMGZKc0pw==',key_name='tempest-keypair-813492960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b442ba233de4096a5e0fa2e04d0853f',ramdisk_id='',reservation_id='r-qyf2fo90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-894639612',owner_user_name='tempest-TaggedAttachmentsTest-894639612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f77ddf30c3a4891991fd2bb6e95b297',uuid=b37a7f95-b429-431a-b837-a650fd1ee27e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converting VIF {"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG os_vif [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3be17c85-68, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17ca365e-33a6-45eb-9dfd-f68ae7a1c558) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:20 user nova-compute[76161]: INFO os_vif [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68')
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:55:20 user nova-compute[76161]:   <nova:package version="0.0.0"/>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:name>tempest-device-tagging-server-235698834</nova:name>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:creationTime>2023-11-14 17:55:20</nova:creationTime>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:flavor name="m1.tiny">
Nov 14 17:55:20 user nova-compute[76161]:     <nova:memory>512</nova:memory>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:disk>1</nova:disk>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:swap>0</nova:swap>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:vcpus>1</nova:vcpus>
Nov 14 17:55:20 user nova-compute[76161]:   </nova:flavor>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:owner>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:user uuid="1f77ddf30c3a4891991fd2bb6e95b297">tempest-TaggedAttachmentsTest-894639612-project-member</nova:user>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:project uuid="3b442ba233de4096a5e0fa2e04d0853f">tempest-TaggedAttachmentsTest-894639612</nova:project>
Nov 14 17:55:20 user nova-compute[76161]:   </nova:owner>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:55:20 user nova-compute[76161]:   <nova:ports>
Nov 14 17:55:20 user nova-compute[76161]:     <nova:port uuid="efc2c7fd-10f7-4ecc-a87d-c2f0c010d992">
Nov 14 17:55:20 user nova-compute[76161]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:55:20 user nova-compute[76161]:     </nova:port>
Nov 14 17:55:20 user nova-compute[76161]:   </nova:ports>
Nov 14 17:55:20 user nova-compute[76161]: </nova:instance>
Nov 14 17:55:20 user nova-compute[76161]:  {{(pid=76161) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.845s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== connect_volume: return (1847ms) {'type': 'block', 'scsi_wwn': '23962663862623665', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962663862623665', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:20 user nova-compute[76161]: WARNING nova.compute.manager [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state resized and task_state resize_reverting.
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-deleted-3be17c85-687c-4e56-a1b8-9af5cee15ed2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:20 user nova-compute[76161]: INFO nova.compute.manager [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Neutron deleted interface 3be17c85-687c-4e56-a1b8-9af5cee15ed2; detaching it from the instance and deleting it from the info cache
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.network.neutron [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updating instance_info_cache with network_info: [{"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kHNWROTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:20 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:55:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:20 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:55:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:20 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance running successfully.
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] finish_revert_migration finished successfully. {{(pid=76161) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 17:55:20 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:55:20 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7230MB free_disk=25.326030731201172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aad4a77-cfac-43f3-b829-d188639b4839]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:20 user nova-compute[76161]: DEBUG nova.objects.instance [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Lazy-loading 'system_metadata' on Instance uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:55:21 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquired lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9fab60-346c-4345-8eed-ea8945134e00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1095895513',display_name='tempest-ServerActionsTestOtherA-server-1304251250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1095895513',id=17,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnUVlrrKY796M2WQb0to34mVHtH8sawDJDiNWfGFXurDBDBklAQgDqd8pjjgIb+0Unj5c6grIFHGUanM3AOdi9gBLjHVsWn12jK6zqkIeGTVVB8fkRDE79sNBqkLYZt1g==',key_name='tempest-keypair-916935358',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:53:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-byfwoe9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=56848a92-97b3-4eef-b924-de8ab85ad115,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:55:21 user nova-compute[76161]:   <uuid>56848a92-97b3-4eef-b924-de8ab85ad115</uuid>
Nov 14 17:55:21 user nova-compute[76161]:   <name>instance-00000011</name>
Nov 14 17:55:21 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:55:21 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:55:21 user nova-compute[76161]:   <metadata>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:55:21 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:55:21 user nova-compute[76161]:       <nova:name>tempest-ServerActionsTestOtherA-server-1304251250</nova:name>
Nov 14 17:55:21 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:55:18</nova:creationTime>
Nov 14 17:55:21 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:55:21 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:55:21 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:55:21 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:55:21 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:55:21 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:55:21 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:55:21 user nova-compute[76161]:       <nova:owner>
Nov 14 17:55:21 user nova-compute[76161]:         <nova:user uuid="bbfeb35beb394e15bf881780f69724f6">tempest-ServerActionsTestOtherA-233736107-project-member</nova:user>
Nov 14 17:55:21 user nova-compute[76161]:         <nova:project uuid="4467aca672a34c1a8f4e1735636d311b">tempest-ServerActionsTestOtherA-233736107</nova:project>
Nov 14 17:55:21 user nova-compute[76161]:       </nova:owner>
Nov 14 17:55:21 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:55:21 user nova-compute[76161]:       <nova:ports>
Nov 14 17:55:21 user nova-compute[76161]:         <nova:port uuid="b2487e15-e0cf-4079-9baf-f522396ce976">
Nov 14 17:55:21 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 17:55:21 user nova-compute[76161]:         </nova:port>
Nov 14 17:55:21 user nova-compute[76161]:       </nova:ports>
Nov 14 17:55:21 user nova-compute[76161]:     </nova:instance>
Nov 14 17:55:21 user nova-compute[76161]:   </metadata>
Nov 14 17:55:21 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:55:21 user nova-compute[76161]:     <system>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name="serial">56848a92-97b3-4eef-b924-de8ab85ad115</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name="uuid">56848a92-97b3-4eef-b924-de8ab85ad115</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:55:21 user nova-compute[76161]:     </system>
Nov 14 17:55:21 user nova-compute[76161]:   </sysinfo>
Nov 14 17:55:21 user nova-compute[76161]:   <os>
Nov 14 17:55:21 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:55:21 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:55:21 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:55:21 user nova-compute[76161]:   </os>
Nov 14 17:55:21 user nova-compute[76161]:   <features>
Nov 14 17:55:21 user nova-compute[76161]:     <acpi/>
Nov 14 17:55:21 user nova-compute[76161]:     <apic/>
Nov 14 17:55:21 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:55:21 user nova-compute[76161]:   </features>
Nov 14 17:55:21 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:55:21 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:55:21 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:55:21 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:55:21 user nova-compute[76161]:   </clock>
Nov 14 17:55:21 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:55:21 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:55:21 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:55:21 user nova-compute[76161]:   </cpu>
Nov 14 17:55:21 user nova-compute[76161]:   <devices>
Nov 14 17:55:21 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:55:21 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:55:21 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk"/>
Nov 14 17:55:21 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:55:21 user nova-compute[76161]:     </disk>
Nov 14 17:55:21 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:55:21 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:55:21 user nova-compute[76161]:       <source dev="/dev/sdc"/>
Nov 14 17:55:21 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 17:55:21 user nova-compute[76161]:       <serial>6d8ec367-5fa5-4318-9647-605d977d3ae7</serial>
Nov 14 17:55:21 user nova-compute[76161]:     </disk>
Nov 14 17:55:21 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:55:21 user nova-compute[76161]:       <mac address="fa:16:3e:46:2d:e4"/>
Nov 14 17:55:21 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:55:21 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:55:21 user nova-compute[76161]:       <target dev="tapb2487e15-e0"/>
Nov 14 17:55:21 user nova-compute[76161]:     </interface>
Nov 14 17:55:21 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:55:21 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/console.log" append="off"/>
Nov 14 17:55:21 user nova-compute[76161]:     </serial>
Nov 14 17:55:21 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:55:21 user nova-compute[76161]:     <video>
Nov 14 17:55:21 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:55:21 user nova-compute[76161]:     </video>
Nov 14 17:55:21 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:55:21 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:55:21 user nova-compute[76161]:     </rng>
Nov 14 17:55:21 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:55:21 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:55:21 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:55:21 user nova-compute[76161]:     </memballoon>
Nov 14 17:55:21 user nova-compute[76161]:   </devices>
Nov 14 17:55:21 user nova-compute[76161]: </domain>
Nov 14 17:55:21 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1095895513',display_name='tempest-ServerActionsTestOtherA-server-1304251250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1095895513',id=17,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnUVlrrKY796M2WQb0to34mVHtH8sawDJDiNWfGFXurDBDBklAQgDqd8pjjgIb+0Unj5c6grIFHGUanM3AOdi9gBLjHVsWn12jK6zqkIeGTVVB8fkRDE79sNBqkLYZt1g==',key_name='tempest-keypair-916935358',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:53:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-byfwoe9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=56848a92-97b3-4eef-b924-de8ab85ad115,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_vif [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8] added
Nov 14 17:55:21 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9031a311-deff-517b-abb7-0b5ea9a21c13', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2487e15-e0, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2487e15-e0, col_values=(('qos', UUID('0a121ea1-f8b8-4c72-bc2c-38d127959d01')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2487e15-e0, col_values=(('external_ids', {'iface-id': 'b2487e15-e0cf-4079-9baf-f522396ce976', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:2d:e4', 'vm-uuid': '56848a92-97b3-4eef-b924-de8ab85ad115'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[20337711-8965-4902-b998-6f456434a68a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:21 user nova-compute[76161]: INFO os_vif [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0')
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ba215-454d-41e5-9e3d-c57e122d40cf]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.objects.instance [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Lazy-loading 'flavor' on Instance uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kHNWROTe {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kHNWROTe" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84e4fd5-6db1-41c1-8717-c8e967cb6822]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kHNWROTe'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d08af22-7369-4eb3-8ea5-95b93014cdb9]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eefeb56-ff2e-461c-975b-9cc4662fd801]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:21 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:21 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:21 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:21 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:21 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:21 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No VIF found with MAC fa:16:3e:46:2d:e4, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.objects.base [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Object Instance<b37a7f95-b429-431a-b837-a650fd1ee27e> lazy-loaded attributes: system_metadata,flavor {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235698834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235698834',id=16,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL15D+kMQspaKeW7+Bx5Dn7IFwRs/JMwFGq2/FmaQr23P9jWrQHvM1225hzBmTZF7rA/Hf1M98y9sJNaTlvjxHJCuE4gTpn+otFGMWDM/pMcafW1YhRqWDPdGRMGZKc0pw==',key_name='tempest-keypair-813492960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b442ba233de4096a5e0fa2e04d0853f',ramdisk_id='',reservation_id='r-qyf2fo90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-894639612',owner_user_name='tempest-TaggedAttachmentsTest-894639612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f77ddf30c3a4891991fd2bb6e95b297',uuid=b37a7f95-b429-431a-b837-a650fd1ee27e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Converting VIF {"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:21 user nova-compute[76161]: INFO nova.compute.manager [None req-d8de695e-8e60-4f51-9a30-b2351c27f1d5 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating instance to original state: 'active'
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2e:c8:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3be17c85-68"/></interface> {{(pid=76161) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b37a7f95-b429-431a-b837-a650fd1ee27e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56848a92-97b3-4eef-b924-de8ab85ad115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 76193048-410d-4a59-9eb5-165d8ce0af6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a1ec772d-0eee-460f-8f52-2daeda1a3232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance f0a6ae6f-72f6-4357-8fe6-a327549d1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance fdcdc21a-3601-4f26-8da3-f345c35d839d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56f47238-81fe-4196-865c-e1ad68cf6fea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2e:c8:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3be17c85-68"/></interface>not found in domain: <domain type='kvm' id='17'>
Nov 14 17:55:21 user nova-compute[76161]:   <name>instance-00000010</name>
Nov 14 17:55:21 user nova-compute[76161]:   <uuid>b37a7f95-b429-431a-b837-a650fd1ee27e</uuid>
Nov 14 17:55:21 user nova-compute[76161]:   <metadata>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:55:21 user nova-compute[76161]:   <nova:package version="0.0.0"/>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:name>tempest-device-tagging-server-235698834</nova:name>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:creationTime>2023-11-14 17:55:20</nova:creationTime>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:flavor name="m1.tiny">
Nov 14 17:55:21 user nova-compute[76161]:     <nova:memory>512</nova:memory>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:disk>1</nova:disk>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:swap>0</nova:swap>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:vcpus>1</nova:vcpus>
Nov 14 17:55:21 user nova-compute[76161]:   </nova:flavor>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:owner>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:user uuid="1f77ddf30c3a4891991fd2bb6e95b297">tempest-TaggedAttachmentsTest-894639612-project-member</nova:user>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:project uuid="3b442ba233de4096a5e0fa2e04d0853f">tempest-TaggedAttachmentsTest-894639612</nova:project>
Nov 14 17:55:21 user nova-compute[76161]:   </nova:owner>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:ports>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:port uuid="efc2c7fd-10f7-4ecc-a87d-c2f0c010d992">
Nov 14 17:55:21 user nova-compute[76161]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:55:21 user nova-compute[76161]:     </nova:port>
Nov 14 17:55:21 user nova-compute[76161]:   </nova:ports>
Nov 14 17:55:21 user nova-compute[76161]: </nova:instance>
Nov 14 17:55:21 user nova-compute[76161]:   </metadata>
Nov 14 17:55:21 user nova-compute[76161]:   <memory unit='KiB'>524288</memory>
Nov 14 17:55:21 user nova-compute[76161]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 17:55:21 user nova-compute[76161]:   <vcpu placement='static'>1</vcpu>
Nov 14 17:55:21 user nova-compute[76161]:   <resource>
Nov 14 17:55:21 user nova-compute[76161]:     <partition>/machine</partition>
Nov 14 17:55:21 user nova-compute[76161]:   </resource>
Nov 14 17:55:21 user nova-compute[76161]:   <sysinfo type='smbios'>
Nov 14 17:55:21 user nova-compute[76161]:     <system>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='version'>0.0.0</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='serial'>b37a7f95-b429-431a-b837-a650fd1ee27e</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='uuid'>b37a7f95-b429-431a-b837-a650fd1ee27e</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='family'>Virtual Machine</entry>
Nov 14 17:55:21 user nova-compute[76161]:     </system>
Nov 14 17:55:21 user nova-compute[76161]:   </sysinfo>
Nov 14 17:55:21 user nova-compute[76161]:   <os>
Nov 14 17:55:21 user nova-compute[76161]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 17:55:21 user nova-compute[76161]:     <boot dev='hd'/>
Nov 14 17:55:21 user nova-compute[76161]:     <smbios mode='sysinfo'/>
Nov 14 17:55:21 user nova-compute[76161]:   </os>
Nov 14 17:55:21 user nova-compute[76161]:   <features>
Nov 14 17:55:21 user nova-compute[76161]:     <acpi/>
Nov 14 17:55:21 user nova-compute[76161]:     <apic/>
Nov 14 17:55:21 user nova-compute[76161]:     <vmcoreinfo state='on'/>
Nov 14 17:55:21 user nova-compute[76161]:   </features>
Nov 14 17:55:21 user nova-compute[76161]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 17:55:21 user nova-compute[76161]:     <model fallback='forbid'>Nehalem</model>
Nov 14 17:55:21 user nova-compute[76161]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 17:55:21 user nova-compute[76161]:     <feature policy='require' name='vme'/>
Nov 14 17:55:21 user nova-compute[76161]:     <feature policy='require' name='x2apic'/>
Nov 14 17:55:21 user nova-compute[76161]:     <feature policy='require' name='hypervisor'/>
Nov 14 17:55:21 user nova-compute[76161]:   </cpu>
Nov 14 17:55:21 user nova-compute[76161]:   <clock offset='utc'>
Nov 14 17:55:21 user nova-compute[76161]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 17:55:21 user nova-compute[76161]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 17:55:21 user nova-compute[76161]:     <timer name='hpet' present='no'/>
Nov 14 17:55:21 user nova-compute[76161]:   </clock>
Nov 14 17:55:21 user nova-compute[76161]:   <on_poweroff>destroy</on_poweroff>
Nov 14 17:55:21 user nova-compute[76161]:   <on_reboot>restart</on_reboot>
Nov 14 17:55:21 user nova-compute[76161]:   <on_crash>destroy</on_crash>
Nov 14 17:55:21 user nova-compute[76161]:   <devices>
Nov 14 17:55:21 user nova-compute[76161]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 17:55:21 user nova-compute[76161]:     <disk type='file' device='disk'>
Nov 14 17:55:21 user nova-compute[76161]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 17:55:21 user nova-compute[76161]:       <source file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk' index='2'/>
Nov 14 17:55:21 user nova-compute[76161]:       <backingStore type='file' index='3'>
Nov 14 17:55:21 user nova-compute[76161]:         <format type='raw'/>
Nov 14 17:55:21 user nova-compute[76161]:         <source file='/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d'/>
Nov 14 17:55:21 user nova-compute[76161]:         <backingStore/>
Nov 14 17:55:21 user nova-compute[76161]:       </backingStore>
Nov 14 17:55:21 user nova-compute[76161]:       <target dev='vda' bus='virtio'/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='virtio-disk0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </disk>
Nov 14 17:55:21 user nova-compute[76161]:     <disk type='file' device='cdrom'>
Nov 14 17:55:21 user nova-compute[76161]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 17:55:21 user nova-compute[76161]:       <source file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.config' index='1'/>
Nov 14 17:55:21 user nova-compute[76161]:       <backingStore/>
Nov 14 17:55:21 user nova-compute[76161]:       <target dev='hda' bus='ide'/>
Nov 14 17:55:21 user nova-compute[76161]:       <readonly/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='ide0-0-0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </disk>
Nov 14 17:55:21 user nova-compute[76161]:     <controller type='usb' index='0' model='none'>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='usb'/>
Nov 14 17:55:21 user nova-compute[76161]:     </controller>
Nov 14 17:55:21 user nova-compute[76161]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='pci.0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </controller>
Nov 14 17:55:21 user nova-compute[76161]:     <controller type='ide' index='0'>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='ide'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 17:55:21 user nova-compute[76161]:     </controller>
Nov 14 17:55:21 user nova-compute[76161]:     <interface type='ethernet'>
Nov 14 17:55:21 user nova-compute[76161]:       <mac address='fa:16:3e:9d:da:2c'/>
Nov 14 17:55:21 user nova-compute[76161]:       <target dev='tapefc2c7fd-10'/>
Nov 14 17:55:21 user nova-compute[76161]:       <model type='virtio'/>
Nov 14 17:55:21 user nova-compute[76161]:       <mtu size='1442'/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='net0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </interface>
Nov 14 17:55:21 user nova-compute[76161]:     <serial type='pty'>
Nov 14 17:55:21 user nova-compute[76161]:       <source path='/dev/pts/7'/>
Nov 14 17:55:21 user nova-compute[76161]:       <log file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/console.log' append='off'/>
Nov 14 17:55:21 user nova-compute[76161]:       <target type='isa-serial' port='0'>
Nov 14 17:55:21 user nova-compute[76161]:         <model name='isa-serial'/>
Nov 14 17:55:21 user nova-compute[76161]:       </target>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='serial0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </serial>
Nov 14 17:55:21 user nova-compute[76161]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 17:55:21 user nova-compute[76161]:       <source path='/dev/pts/7'/>
Nov 14 17:55:21 user nova-compute[76161]:       <log file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/console.log' append='off'/>
Nov 14 17:55:21 user nova-compute[76161]:       <target type='serial' port='0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='serial0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </console>
Nov 14 17:55:21 user nova-compute[76161]:     <input type='mouse' bus='ps2'>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='input0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </input>
Nov 14 17:55:21 user nova-compute[76161]:     <input type='keyboard' bus='ps2'>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='input1'/>
Nov 14 17:55:21 user nova-compute[76161]:     </input>
Nov 14 17:55:21 user nova-compute[76161]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Nov 14 17:55:21 user nova-compute[76161]:       <listen type='address' address='0.0.0.0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </graphics>
Nov 14 17:55:21 user nova-compute[76161]:     <audio id='1' type='none'/>
Nov 14 17:55:21 user nova-compute[76161]:     <video>
Nov 14 17:55:21 user nova-compute[76161]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='video0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </video>
Nov 14 17:55:21 user nova-compute[76161]:     <memballoon model='virtio'>
Nov 14 17:55:21 user nova-compute[76161]:       <stats period='10'/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='balloon0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </memballoon>
Nov 14 17:55:21 user nova-compute[76161]:     <rng model='virtio'>
Nov 14 17:55:21 user nova-compute[76161]:       <backend model='random'>/dev/urandom</backend>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='rng0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </rng>
Nov 14 17:55:21 user nova-compute[76161]:   </devices>
Nov 14 17:55:21 user nova-compute[76161]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 17:55:21 user nova-compute[76161]:     <label>libvirt-b37a7f95-b429-431a-b837-a650fd1ee27e</label>
Nov 14 17:55:21 user nova-compute[76161]:     <imagelabel>libvirt-b37a7f95-b429-431a-b837-a650fd1ee27e</imagelabel>
Nov 14 17:55:21 user nova-compute[76161]:   </seclabel>
Nov 14 17:55:21 user nova-compute[76161]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 17:55:21 user nova-compute[76161]:     <label>+64055:+108</label>
Nov 14 17:55:21 user nova-compute[76161]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 17:55:21 user nova-compute[76161]:   </seclabel>
Nov 14 17:55:21 user nova-compute[76161]: </domain>
Nov 14 17:55:21 user nova-compute[76161]:  {{(pid=76161) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2e:c8:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3be17c85-68"/></interface> {{(pid=76161) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2e:c8:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap3be17c85-68"/></interface>not found in domain: <domain type='kvm' id='17'>
Nov 14 17:55:21 user nova-compute[76161]:   <name>instance-00000010</name>
Nov 14 17:55:21 user nova-compute[76161]:   <uuid>b37a7f95-b429-431a-b837-a650fd1ee27e</uuid>
Nov 14 17:55:21 user nova-compute[76161]:   <metadata>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:55:21 user nova-compute[76161]:   <nova:package version="0.0.0"/>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:name>tempest-device-tagging-server-235698834</nova:name>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:creationTime>2023-11-14 17:55:20</nova:creationTime>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:flavor name="m1.tiny">
Nov 14 17:55:21 user nova-compute[76161]:     <nova:memory>512</nova:memory>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:disk>1</nova:disk>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:swap>0</nova:swap>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:vcpus>1</nova:vcpus>
Nov 14 17:55:21 user nova-compute[76161]:   </nova:flavor>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:owner>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:user uuid="1f77ddf30c3a4891991fd2bb6e95b297">tempest-TaggedAttachmentsTest-894639612-project-member</nova:user>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:project uuid="3b442ba233de4096a5e0fa2e04d0853f">tempest-TaggedAttachmentsTest-894639612</nova:project>
Nov 14 17:55:21 user nova-compute[76161]:   </nova:owner>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:ports>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:port uuid="efc2c7fd-10f7-4ecc-a87d-c2f0c010d992">
Nov 14 17:55:21 user nova-compute[76161]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:55:21 user nova-compute[76161]:     </nova:port>
Nov 14 17:55:21 user nova-compute[76161]:   </nova:ports>
Nov 14 17:55:21 user nova-compute[76161]: </nova:instance>
Nov 14 17:55:21 user nova-compute[76161]:   </metadata>
Nov 14 17:55:21 user nova-compute[76161]:   <memory unit='KiB'>524288</memory>
Nov 14 17:55:21 user nova-compute[76161]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 17:55:21 user nova-compute[76161]:   <vcpu placement='static'>1</vcpu>
Nov 14 17:55:21 user nova-compute[76161]:   <resource>
Nov 14 17:55:21 user nova-compute[76161]:     <partition>/machine</partition>
Nov 14 17:55:21 user nova-compute[76161]:   </resource>
Nov 14 17:55:21 user nova-compute[76161]:   <sysinfo type='smbios'>
Nov 14 17:55:21 user nova-compute[76161]:     <system>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='version'>0.0.0</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='serial'>b37a7f95-b429-431a-b837-a650fd1ee27e</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='uuid'>b37a7f95-b429-431a-b837-a650fd1ee27e</entry>
Nov 14 17:55:21 user nova-compute[76161]:       <entry name='family'>Virtual Machine</entry>
Nov 14 17:55:21 user nova-compute[76161]:     </system>
Nov 14 17:55:21 user nova-compute[76161]:   </sysinfo>
Nov 14 17:55:21 user nova-compute[76161]:   <os>
Nov 14 17:55:21 user nova-compute[76161]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 17:55:21 user nova-compute[76161]:     <boot dev='hd'/>
Nov 14 17:55:21 user nova-compute[76161]:     <smbios mode='sysinfo'/>
Nov 14 17:55:21 user nova-compute[76161]:   </os>
Nov 14 17:55:21 user nova-compute[76161]:   <features>
Nov 14 17:55:21 user nova-compute[76161]:     <acpi/>
Nov 14 17:55:21 user nova-compute[76161]:     <apic/>
Nov 14 17:55:21 user nova-compute[76161]:     <vmcoreinfo state='on'/>
Nov 14 17:55:21 user nova-compute[76161]:   </features>
Nov 14 17:55:21 user nova-compute[76161]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 17:55:21 user nova-compute[76161]:     <model fallback='forbid'>Nehalem</model>
Nov 14 17:55:21 user nova-compute[76161]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 17:55:21 user nova-compute[76161]:     <feature policy='require' name='vme'/>
Nov 14 17:55:21 user nova-compute[76161]:     <feature policy='require' name='x2apic'/>
Nov 14 17:55:21 user nova-compute[76161]:     <feature policy='require' name='hypervisor'/>
Nov 14 17:55:21 user nova-compute[76161]:   </cpu>
Nov 14 17:55:21 user nova-compute[76161]:   <clock offset='utc'>
Nov 14 17:55:21 user nova-compute[76161]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 17:55:21 user nova-compute[76161]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 17:55:21 user nova-compute[76161]:     <timer name='hpet' present='no'/>
Nov 14 17:55:21 user nova-compute[76161]:   </clock>
Nov 14 17:55:21 user nova-compute[76161]:   <on_poweroff>destroy</on_poweroff>
Nov 14 17:55:21 user nova-compute[76161]:   <on_reboot>restart</on_reboot>
Nov 14 17:55:21 user nova-compute[76161]:   <on_crash>destroy</on_crash>
Nov 14 17:55:21 user nova-compute[76161]:   <devices>
Nov 14 17:55:21 user nova-compute[76161]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 17:55:21 user nova-compute[76161]:     <disk type='file' device='disk'>
Nov 14 17:55:21 user nova-compute[76161]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 17:55:21 user nova-compute[76161]:       <source file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk' index='2'/>
Nov 14 17:55:21 user nova-compute[76161]:       <backingStore type='file' index='3'>
Nov 14 17:55:21 user nova-compute[76161]:         <format type='raw'/>
Nov 14 17:55:21 user nova-compute[76161]:         <source file='/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d'/>
Nov 14 17:55:21 user nova-compute[76161]:         <backingStore/>
Nov 14 17:55:21 user nova-compute[76161]:       </backingStore>
Nov 14 17:55:21 user nova-compute[76161]:       <target dev='vda' bus='virtio'/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='virtio-disk0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </disk>
Nov 14 17:55:21 user nova-compute[76161]:     <disk type='file' device='cdrom'>
Nov 14 17:55:21 user nova-compute[76161]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 17:55:21 user nova-compute[76161]:       <source file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/disk.config' index='1'/>
Nov 14 17:55:21 user nova-compute[76161]:       <backingStore/>
Nov 14 17:55:21 user nova-compute[76161]:       <target dev='hda' bus='ide'/>
Nov 14 17:55:21 user nova-compute[76161]:       <readonly/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='ide0-0-0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </disk>
Nov 14 17:55:21 user nova-compute[76161]:     <controller type='usb' index='0' model='none'>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='usb'/>
Nov 14 17:55:21 user nova-compute[76161]:     </controller>
Nov 14 17:55:21 user nova-compute[76161]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='pci.0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </controller>
Nov 14 17:55:21 user nova-compute[76161]:     <controller type='ide' index='0'>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='ide'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 17:55:21 user nova-compute[76161]:     </controller>
Nov 14 17:55:21 user nova-compute[76161]:     <interface type='ethernet'>
Nov 14 17:55:21 user nova-compute[76161]:       <mac address='fa:16:3e:9d:da:2c'/>
Nov 14 17:55:21 user nova-compute[76161]:       <target dev='tapefc2c7fd-10'/>
Nov 14 17:55:21 user nova-compute[76161]:       <model type='virtio'/>
Nov 14 17:55:21 user nova-compute[76161]:       <mtu size='1442'/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='net0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </interface>
Nov 14 17:55:21 user nova-compute[76161]:     <serial type='pty'>
Nov 14 17:55:21 user nova-compute[76161]:       <source path='/dev/pts/7'/>
Nov 14 17:55:21 user nova-compute[76161]:       <log file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/console.log' append='off'/>
Nov 14 17:55:21 user nova-compute[76161]:       <target type='isa-serial' port='0'>
Nov 14 17:55:21 user nova-compute[76161]:         <model name='isa-serial'/>
Nov 14 17:55:21 user nova-compute[76161]:       </target>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='serial0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </serial>
Nov 14 17:55:21 user nova-compute[76161]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 17:55:21 user nova-compute[76161]:       <source path='/dev/pts/7'/>
Nov 14 17:55:21 user nova-compute[76161]:       <log file='/opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e/console.log' append='off'/>
Nov 14 17:55:21 user nova-compute[76161]:       <target type='serial' port='0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='serial0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </console>
Nov 14 17:55:21 user nova-compute[76161]:     <input type='mouse' bus='ps2'>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='input0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </input>
Nov 14 17:55:21 user nova-compute[76161]:     <input type='keyboard' bus='ps2'>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='input1'/>
Nov 14 17:55:21 user nova-compute[76161]:     </input>
Nov 14 17:55:21 user nova-compute[76161]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Nov 14 17:55:21 user nova-compute[76161]:       <listen type='address' address='0.0.0.0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </graphics>
Nov 14 17:55:21 user nova-compute[76161]:     <audio id='1' type='none'/>
Nov 14 17:55:21 user nova-compute[76161]:     <video>
Nov 14 17:55:21 user nova-compute[76161]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='video0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </video>
Nov 14 17:55:21 user nova-compute[76161]:     <memballoon model='virtio'>
Nov 14 17:55:21 user nova-compute[76161]:       <stats period='10'/>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='balloon0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </memballoon>
Nov 14 17:55:21 user nova-compute[76161]:     <rng model='virtio'>
Nov 14 17:55:21 user nova-compute[76161]:       <backend model='random'>/dev/urandom</backend>
Nov 14 17:55:21 user nova-compute[76161]:       <alias name='rng0'/>
Nov 14 17:55:21 user nova-compute[76161]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 17:55:21 user nova-compute[76161]:     </rng>
Nov 14 17:55:21 user nova-compute[76161]:   </devices>
Nov 14 17:55:21 user nova-compute[76161]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 17:55:21 user nova-compute[76161]:     <label>libvirt-b37a7f95-b429-431a-b837-a650fd1ee27e</label>
Nov 14 17:55:21 user nova-compute[76161]:     <imagelabel>libvirt-b37a7f95-b429-431a-b837-a650fd1ee27e</imagelabel>
Nov 14 17:55:21 user nova-compute[76161]:   </seclabel>
Nov 14 17:55:21 user nova-compute[76161]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 17:55:21 user nova-compute[76161]:     <label>+64055:+108</label>
Nov 14 17:55:21 user nova-compute[76161]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 17:55:21 user nova-compute[76161]:   </seclabel>
Nov 14 17:55:21 user nova-compute[76161]: </domain>
Nov 14 17:55:21 user nova-compute[76161]:  {{(pid=76161) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 17:55:21 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Detaching interface fa:16:3e:2e:c8:2b failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap3be17c85-68' not found.
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235698834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235698834',id=16,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL15D+kMQspaKeW7+Bx5Dn7IFwRs/JMwFGq2/FmaQr23P9jWrQHvM1225hzBmTZF7rA/Hf1M98y9sJNaTlvjxHJCuE4gTpn+otFGMWDM/pMcafW1YhRqWDPdGRMGZKc0pw==',key_name='tempest-keypair-813492960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b442ba233de4096a5e0fa2e04d0853f',ramdisk_id='',reservation_id='r-qyf2fo90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-894639612',owner_user_name='tempest-TaggedAttachmentsTest-894639612-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f77ddf30c3a4891991fd2bb6e95b297',uuid=b37a7f95-b429-431a-b837-a650fd1ee27e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Converting VIF {"id": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "address": "fa:16:3e:2e:c8:2b", "network": {"id": "df91aab4-0353-4190-9830-e4ed0bcdcff5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1587457418", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17c85-68", "ovs_interfaceid": "3be17c85-687c-4e56-a1b8-9af5cee15ed2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_vif [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3be17c85-68, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:55:21 user nova-compute[76161]: INFO os_vif [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c8:2b,bridge_name='br-int',has_traffic_filtering=True,id=3be17c85-687c-4e56-a1b8-9af5cee15ed2,network=Network(df91aab4-0353-4190-9830-e4ed0bcdcff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17c85-68')
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [req-b06ef5f2-422b-496c-a04e-f7efced87329 req-3084823b-8756-403b-8abb-2a95fe5bd6d3 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:55:21 user nova-compute[76161]:   <nova:package version="0.0.0"/>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:name>tempest-device-tagging-server-235698834</nova:name>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:creationTime>2023-11-14 17:55:21</nova:creationTime>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:flavor name="m1.tiny">
Nov 14 17:55:21 user nova-compute[76161]:     <nova:memory>512</nova:memory>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:disk>1</nova:disk>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:swap>0</nova:swap>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:vcpus>1</nova:vcpus>
Nov 14 17:55:21 user nova-compute[76161]:   </nova:flavor>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:owner>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:user uuid="1f77ddf30c3a4891991fd2bb6e95b297">tempest-TaggedAttachmentsTest-894639612-project-member</nova:user>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:project uuid="3b442ba233de4096a5e0fa2e04d0853f">tempest-TaggedAttachmentsTest-894639612</nova:project>
Nov 14 17:55:21 user nova-compute[76161]:   </nova:owner>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:55:21 user nova-compute[76161]:   <nova:ports>
Nov 14 17:55:21 user nova-compute[76161]:     <nova:port uuid="efc2c7fd-10f7-4ecc-a87d-c2f0c010d992">
Nov 14 17:55:21 user nova-compute[76161]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:55:21 user nova-compute[76161]:     </nova:port>
Nov 14 17:55:21 user nova-compute[76161]:   </nova:ports>
Nov 14 17:55:21 user nova-compute[76161]: </nova:instance>
Nov 14 17:55:21 user nova-compute[76161]:  {{(pid=76161) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1006db-f242-4b93-ac60-5c799a30a84b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8, portal: 172.16.0.220,3260]
Nov 14 17:55:21 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8, portal: 172.16.0.220,3260] successful.
Nov 14 17:55:21 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22f7399-2b4b-4fb7-b41a-f68f5f127bd2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[152f0397-eedf-4fc1-a70b-2de7193648f3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:21 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:21 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:21 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:55:21 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:21 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:21 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:21 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:55:21 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d269b2-04f3-4371-8420-04855f67808b]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kHNWROTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updating instance_info_cache with network_info: [{"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Releasing lock "refresh_cache-b37a7f95-b429-431a-b837-a650fd1ee27e" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-838610d7-260f-4723-9384-a1690cd0b5c5 tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "interface-b37a7f95-b429-431a-b837-a650fd1ee27e-3be17c85-687c-4e56-a1b8-9af5cee15ed2" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.898s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:55:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.712s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23864636335353330', 'path': '/dev/sde'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864636335353330', 'path': '/dev/sde'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:55:22 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'flavor' on Instance uuid 76193048-410d-4a59-9eb5-165d8ce0af6c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:55:22 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:55:22 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 17:55:22 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:55:22 user nova-compute[76161]:   <serial>ed314789-1cd9-44ce-bd41-d54d6db6a8f8</serial>
Nov 14 17:55:22 user nova-compute[76161]: </disk>
Nov 14 17:55:22 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No VIF found with MAC fa:16:3e:f3:37:1d, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a879fb9d-ce79-4643-b0f3-1752756db195 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.724s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-36bd9b73-f5e6-4eb3-ab5e-a91085f5c095 req-b6aed3eb-2138-4b7c-8e1e-9450fa596698 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-36bd9b73-f5e6-4eb3-ab5e-a91085f5c095 req-b6aed3eb-2138-4b7c-8e1e-9450fa596698 service nova] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-36bd9b73-f5e6-4eb3-ab5e-a91085f5c095 req-b6aed3eb-2138-4b7c-8e1e-9450fa596698 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-36bd9b73-f5e6-4eb3-ab5e-a91085f5c095 req-b6aed3eb-2138-4b7c-8e1e-9450fa596698 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-36bd9b73-f5e6-4eb3-ab5e-a91085f5c095 req-b6aed3eb-2138-4b7c-8e1e-9450fa596698 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] No waiting events found dispatching network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:23 user nova-compute[76161]: WARNING nova.compute.manager [req-36bd9b73-f5e6-4eb3-ab5e-a91085f5c095 req-b6aed3eb-2138-4b7c-8e1e-9450fa596698 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received unexpected event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 17:55:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-60e5c40a-7830-4072-bcf1-52b322b0b9a3 req-03754dc9-7729-4d4d-820d-ad437540141a service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-60e5c40a-7830-4072-bcf1-52b322b0b9a3 req-03754dc9-7729-4d4d-820d-ad437540141a service nova] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-60e5c40a-7830-4072-bcf1-52b322b0b9a3 req-03754dc9-7729-4d4d-820d-ad437540141a service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-60e5c40a-7830-4072-bcf1-52b322b0b9a3 req-03754dc9-7729-4d4d-820d-ad437540141a service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-60e5c40a-7830-4072-bcf1-52b322b0b9a3 req-03754dc9-7729-4d4d-820d-ad437540141a service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] No waiting events found dispatching network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:25 user nova-compute[76161]: WARNING nova.compute.manager [req-60e5c40a-7830-4072-bcf1-52b322b0b9a3 req-03754dc9-7729-4d4d-820d-ad437540141a service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received unexpected event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:55:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Instance spawned successfully.
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Trying to apply a migration context that does not seem to be set for this instance {{(pid=76161) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 17:55:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e04947d-0675-4937-9343-6f17cd79b99d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.090s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "7eeac8f5-64d4-4da0-817f-376603bb54a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:55:27 user nova-compute[76161]: INFO nova.compute.claims [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Claim successful on node user
Nov 14 17:55:27 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:55:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:55:28 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:55:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG nova.policy [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49edd5581ca44780ac590c2b072b338d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45eab8e344af47a2b1b28fa471a4acc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:55:28 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Creating image(s)
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "/opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "/opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "/opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-c7948d6c-c5bc-479f-b302-9243f6783532 req-bc347983-dbe1-4c95-a982-1011f6043913 service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received event network-changed-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-c7948d6c-c5bc-479f-b302-9243f6783532 req-bc347983-dbe1-4c95-a982-1011f6043913 service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Refreshing instance network info cache due to event network-changed-ea45b27f-34f8-4051-98f1-486c4f32d35a. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c7948d6c-c5bc-479f-b302-9243f6783532 req-bc347983-dbe1-4c95-a982-1011f6043913 service nova] Acquiring lock "refresh_cache-a1ec772d-0eee-460f-8f52-2daeda1a3232" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c7948d6c-c5bc-479f-b302-9243f6783532 req-bc347983-dbe1-4c95-a982-1011f6043913 service nova] Acquired lock "refresh_cache-a1ec772d-0eee-460f-8f52-2daeda1a3232" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG nova.network.neutron [req-c7948d6c-c5bc-479f-b302-9243f6783532 req-bc347983-dbe1-4c95-a982-1011f6043913 service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Refreshing network info cache for port ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.213s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk 1073741824" returned: 0 in 0.052s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lazy-loading 'flavor' on Instance uuid a1ec772d-0eee-460f-8f52-2daeda1a3232 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:28 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Ignoring supplied device name: /dev/vdb
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Successfully created port: ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.212s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:55:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:29 user nova-compute[76161]: INFO nova.compute.manager [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Attaching volume 4bcf4def-4d47-407e-9cb4-9aac3f2eac4f to /dev/vdb
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.network.neutron [req-c7948d6c-c5bc-479f-b302-9243f6783532 req-bc347983-dbe1-4c95-a982-1011f6043913 service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Updated VIF entry in instance network info cache for port ea45b27f-34f8-4051-98f1-486c4f32d35a. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.network.neutron [req-c7948d6c-c5bc-479f-b302-9243f6783532 req-bc347983-dbe1-4c95-a982-1011f6043913 service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Updating instance_info_cache with network_info: [{"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c7948d6c-c5bc-479f-b302-9243f6783532 req-bc347983-dbe1-4c95-a982-1011f6043913 service nova] Releasing lock "refresh_cache-a1ec772d-0eee-460f-8f52-2daeda1a3232" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Cannot resize image /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Ensure instance console log exists: /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG os_brick.utils [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d4f1c8-9c07-4c6d-b49d-5d0a0b483704]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a00b00-c572-4b05-9f77-58c416b861ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50ea994-eb9d-442e-827a-d3fbf55f2647]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce762ec-baf3-4758-bfe8-447ea8115fb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:29 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[140d9686-2751-455a-900c-6b38e6c49cc6]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG os_brick.utils [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Updating existing volume attachment record: 02490c7a-bb6f-4350-acd9-b1f4cc453250 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.network.neutron [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Successfully updated port: ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "refresh_cache-7eeac8f5-64d4-4da0-817f-376603bb54a1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquired lock "refresh_cache-7eeac8f5-64d4-4da0-817f-376603bb54a1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.network.neutron [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-b9237bc4-b1a4-4250-ab74-7df43947aa68 req-12904052-9780-4cae-8b38-7b393fc589ac service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Received event network-changed-ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-b9237bc4-b1a4-4250-ab74-7df43947aa68 req-12904052-9780-4cae-8b38-7b393fc589ac service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Refreshing instance network info cache due to event network-changed-ebc07478-edbf-4287-a29e-3015527a60d4. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b9237bc4-b1a4-4250-ab74-7df43947aa68 req-12904052-9780-4cae-8b38-7b393fc589ac service nova] Acquiring lock "refresh_cache-7eeac8f5-64d4-4da0-817f-376603bb54a1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG nova.network.neutron [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:55:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.network.neutron [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Updating instance_info_cache with network_info: [{"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Releasing lock "refresh_cache-7eeac8f5-64d4-4da0-817f-376603bb54a1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Instance network_info: |[{"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b9237bc4-b1a4-4250-ab74-7df43947aa68 req-12904052-9780-4cae-8b38-7b393fc589ac service nova] Acquired lock "refresh_cache-7eeac8f5-64d4-4da0-817f-376603bb54a1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.network.neutron [req-b9237bc4-b1a4-4250-ab74-7df43947aa68 req-12904052-9780-4cae-8b38-7b393fc589ac service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Refreshing network info cache for port ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Start _get_guest_xml network_info=[{"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:55:30 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:55:30 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2072328386',display_name='tempest-AttachVolumeNegativeTest-server-2072328386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2072328386',id=23,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOQkGev2TJ17CRibkPstuAcMPOYnPfFCUvyoujm4MSbNLXERF5WPBDZ3b/daiBa4Pts/XBKlj7qOS6BFPrlzrgmHEr4T88me7ynDNQcMRsdSGkRnPZPac1DKLMixy190A==',key_name='tempest-keypair-1019750047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-jsc1uhg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:55:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=7eeac8f5-64d4-4da0-817f-376603bb54a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e4:83,bridge_name='br-int',has_traffic_filtering=True,id=ebc07478-edbf-4287-a29e-3015527a60d4,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc07478-ed') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'pci_devices' on Instance uuid 7eeac8f5-64d4-4da0-817f-376603bb54a1 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:55:30 user nova-compute[76161]:   <uuid>7eeac8f5-64d4-4da0-817f-376603bb54a1</uuid>
Nov 14 17:55:30 user nova-compute[76161]:   <name>instance-00000017</name>
Nov 14 17:55:30 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:55:30 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:55:30 user nova-compute[76161]:   <metadata>
Nov 14 17:55:30 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:55:30 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:55:30 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2072328386</nova:name>
Nov 14 17:55:30 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:55:30</nova:creationTime>
Nov 14 17:55:30 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:55:30 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:55:30 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:55:30 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:55:30 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:55:30 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:55:30 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:55:30 user nova-compute[76161]:       <nova:owner>
Nov 14 17:55:30 user nova-compute[76161]:         <nova:user uuid="49edd5581ca44780ac590c2b072b338d">tempest-AttachVolumeNegativeTest-453609882-project-member</nova:user>
Nov 14 17:55:30 user nova-compute[76161]:         <nova:project uuid="45eab8e344af47a2b1b28fa471a4acc3">tempest-AttachVolumeNegativeTest-453609882</nova:project>
Nov 14 17:55:30 user nova-compute[76161]:       </nova:owner>
Nov 14 17:55:30 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:55:30 user nova-compute[76161]:       <nova:ports>
Nov 14 17:55:30 user nova-compute[76161]:         <nova:port uuid="ebc07478-edbf-4287-a29e-3015527a60d4">
Nov 14 17:55:30 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 17:55:30 user nova-compute[76161]:         </nova:port>
Nov 14 17:55:30 user nova-compute[76161]:       </nova:ports>
Nov 14 17:55:30 user nova-compute[76161]:     </nova:instance>
Nov 14 17:55:30 user nova-compute[76161]:   </metadata>
Nov 14 17:55:30 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:55:30 user nova-compute[76161]:     <system>
Nov 14 17:55:30 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:55:30 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:55:30 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:55:30 user nova-compute[76161]:       <entry name="serial">7eeac8f5-64d4-4da0-817f-376603bb54a1</entry>
Nov 14 17:55:30 user nova-compute[76161]:       <entry name="uuid">7eeac8f5-64d4-4da0-817f-376603bb54a1</entry>
Nov 14 17:55:30 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:55:30 user nova-compute[76161]:     </system>
Nov 14 17:55:30 user nova-compute[76161]:   </sysinfo>
Nov 14 17:55:30 user nova-compute[76161]:   <os>
Nov 14 17:55:30 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:55:30 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:55:30 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:55:30 user nova-compute[76161]:   </os>
Nov 14 17:55:30 user nova-compute[76161]:   <features>
Nov 14 17:55:30 user nova-compute[76161]:     <acpi/>
Nov 14 17:55:30 user nova-compute[76161]:     <apic/>
Nov 14 17:55:30 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:55:30 user nova-compute[76161]:   </features>
Nov 14 17:55:30 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:55:30 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:55:30 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:55:30 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:55:30 user nova-compute[76161]:   </clock>
Nov 14 17:55:30 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:55:30 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:55:30 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:55:30 user nova-compute[76161]:   </cpu>
Nov 14 17:55:30 user nova-compute[76161]:   <devices>
Nov 14 17:55:30 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:55:30 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:55:30 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk"/>
Nov 14 17:55:30 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:55:30 user nova-compute[76161]:     </disk>
Nov 14 17:55:30 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:55:30 user nova-compute[76161]:       <mac address="fa:16:3e:ca:e4:83"/>
Nov 14 17:55:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:55:30 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:55:30 user nova-compute[76161]:       <target dev="tapebc07478-ed"/>
Nov 14 17:55:30 user nova-compute[76161]:     </interface>
Nov 14 17:55:30 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:55:30 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/console.log" append="off"/>
Nov 14 17:55:30 user nova-compute[76161]:     </serial>
Nov 14 17:55:30 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:55:30 user nova-compute[76161]:     <video>
Nov 14 17:55:30 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:55:30 user nova-compute[76161]:     </video>
Nov 14 17:55:30 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:55:30 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:55:30 user nova-compute[76161]:     </rng>
Nov 14 17:55:30 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:55:30 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:55:30 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:55:30 user nova-compute[76161]:     </memballoon>
Nov 14 17:55:30 user nova-compute[76161]:   </devices>
Nov 14 17:55:30 user nova-compute[76161]: </domain>
Nov 14 17:55:30 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2072328386',display_name='tempest-AttachVolumeNegativeTest-server-2072328386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2072328386',id=23,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOQkGev2TJ17CRibkPstuAcMPOYnPfFCUvyoujm4MSbNLXERF5WPBDZ3b/daiBa4Pts/XBKlj7qOS6BFPrlzrgmHEr4T88me7ynDNQcMRsdSGkRnPZPac1DKLMixy190A==',key_name='tempest-keypair-1019750047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-jsc1uhg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:55:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=7eeac8f5-64d4-4da0-817f-376603bb54a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e4:83,bridge_name='br-int',has_traffic_filtering=True,id=ebc07478-edbf-4287-a29e-3015527a60d4,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc07478-ed') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG os_vif [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e4:83,bridge_name='br-int',has_traffic_filtering=True,id=ebc07478-edbf-4287-a29e-3015527a60d4,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc07478-ed') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f88e77b0-a174-5ffa-8d35-a3c45f76a4b9', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebc07478-ed, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebc07478-ed, col_values=(('qos', UUID('6911f985-14b9-4eb4-9a57-1794be0aaa41')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebc07478-ed, col_values=(('external_ids', {'iface-id': 'ebc07478-edbf-4287-a29e-3015527a60d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:e4:83', 'vm-uuid': '7eeac8f5-64d4-4da0-817f-376603bb54a1'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:30 user nova-compute[76161]: INFO os_vif [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e4:83,bridge_name='br-int',has_traffic_filtering=True,id=ebc07478-edbf-4287-a29e-3015527a60d4,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc07478-ed')
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No VIF found with MAC fa:16:3e:ca:e4:83, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.network.neutron [req-b9237bc4-b1a4-4250-ab74-7df43947aa68 req-12904052-9780-4cae-8b38-7b393fc589ac service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Updated VIF entry in instance network info cache for port ebc07478-edbf-4287-a29e-3015527a60d4. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG nova.network.neutron [req-b9237bc4-b1a4-4250-ab74-7df43947aa68 req-12904052-9780-4cae-8b38-7b393fc589ac service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Updating instance_info_cache with network_info: [{"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b9237bc4-b1a4-4250-ab74-7df43947aa68 req-12904052-9780-4cae-8b38-7b393fc589ac service nova] Releasing lock "refresh_cache-7eeac8f5-64d4-4da0-817f-376603bb54a1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:55:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-50c7d2cc-6064-4554-a324-9018e3362ee3 req-46bfaadb-3c9e-4e8a-a67d-e051b5fa4391 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Received event network-vif-plugged-ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50c7d2cc-6064-4554-a324-9018e3362ee3 req-46bfaadb-3c9e-4e8a-a67d-e051b5fa4391 service nova] Acquiring lock "7eeac8f5-64d4-4da0-817f-376603bb54a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50c7d2cc-6064-4554-a324-9018e3362ee3 req-46bfaadb-3c9e-4e8a-a67d-e051b5fa4391 service nova] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50c7d2cc-6064-4554-a324-9018e3362ee3 req-46bfaadb-3c9e-4e8a-a67d-e051b5fa4391 service nova] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-50c7d2cc-6064-4554-a324-9018e3362ee3 req-46bfaadb-3c9e-4e8a-a67d-e051b5fa4391 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] No waiting events found dispatching network-vif-plugged-ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:32 user nova-compute[76161]: WARNING nova.compute.manager [req-50c7d2cc-6064-4554-a324-9018e3362ee3 req-46bfaadb-3c9e-4e8a-a67d-e051b5fa4391 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Received unexpected event network-vif-plugged-ebc07478-edbf-4287-a29e-3015527a60d4 for instance with vm_state building and task_state spawning.
Nov 14 17:55:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOEHkjNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:33 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:55:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:33 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:55:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:55:33 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:55:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:33 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Instance spawned successfully.
Nov 14 17:55:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[596001ac-c2e6-4c2f-8b10-fa62ddb96187]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:55:33 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[befb01d8-af99-40d9-91a5-1810a64444f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f] added
Nov 14 17:55:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[095997d7-34d3-4a68-a005-d92cb374047e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[823f778f-9b77-48b3-9955-abcd8ade52a5]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bOEHkjNX {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:34 user nova-compute[76161]: INFO nova.compute.manager [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-d17eeee8-fb61-497d-af89-3d044fc3e0c6 req-e98c57a3-1e06-4952-ace8-1fde23c9aeff service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Received event network-vif-plugged-ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d17eeee8-fb61-497d-af89-3d044fc3e0c6 req-e98c57a3-1e06-4952-ace8-1fde23c9aeff service nova] Acquiring lock "7eeac8f5-64d4-4da0-817f-376603bb54a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d17eeee8-fb61-497d-af89-3d044fc3e0c6 req-e98c57a3-1e06-4952-ace8-1fde23c9aeff service nova] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d17eeee8-fb61-497d-af89-3d044fc3e0c6 req-e98c57a3-1e06-4952-ace8-1fde23c9aeff service nova] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-d17eeee8-fb61-497d-af89-3d044fc3e0c6 req-e98c57a3-1e06-4952-ace8-1fde23c9aeff service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] No waiting events found dispatching network-vif-plugged-ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:34 user nova-compute[76161]: WARNING nova.compute.manager [req-d17eeee8-fb61-497d-af89-3d044fc3e0c6 req-e98c57a3-1e06-4952-ace8-1fde23c9aeff service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Received unexpected event network-vif-plugged-ebc07478-edbf-4287-a29e-3015527a60d4 for instance with vm_state building and task_state spawning.
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bOEHkjNX" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5939f42-6794-4a96-9786-b0287f847035]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bOEHkjNX'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2681a60-44c8-4421-bb10-c4d081d58be7]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:34 user nova-compute[76161]: INFO nova.compute.manager [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Took 6.85 seconds to build instance.
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[79818ef0-4e49-48d3-bf09-cfa344d93654]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0aac4da3-c158-4a10-9ec6-6647e2704026 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.946s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5692f54-6a3f-48a7-835c-effa1e048f48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f, portal: 172.16.0.220,3260]
Nov 14 17:55:34 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f, portal: 172.16.0.220,3260] successful.
Nov 14 17:55:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cf3c83-44af-406a-af8e-e2e1a76a6b3c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c066f2-3435-41f1-b9df-de13b0e2ccdc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)
Nov 14 17:55:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:55:34 user nova-compute[76161]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)
Nov 14 17:55:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d80cc-d325-4936-b58d-3a5c733862d7]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOEHkjNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 56f47238-81fe-4196-865c-e1ad68cf6fea {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 1040ce71-437b-4398-9bb5-bd34e86589a7 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 76193048-410d-4a59-9eb5-165d8ce0af6c {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid a1ec772d-0eee-460f-8f52-2daeda1a3232 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid f0a6ae6f-72f6-4357-8fe6-a327549d1918 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid fdcdc21a-3601-4f26-8da3-f345c35d839d {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 6e87b617-e12f-4c33-bd5d-8f1bc07c417b {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 7eeac8f5-64d4-4da0-817f-376603bb54a1 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 56848a92-97b3-4eef-b924-de8ab85ad115 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "1040ce71-437b-4398-9bb5-bd34e86589a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "76193048-410d-4a59-9eb5-165d8ce0af6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "7eeac8f5-64d4-4da0-817f-376603bb54a1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:34 user nova-compute[76161]: WARNING oslo_messaging._drivers.amqpdriver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:55:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23133336262333262', 'path': '/dev/sdf'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133336262333262', 'path': '/dev/sdf'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:55:35 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lazy-loading 'flavor' on Instance uuid a1ec772d-0eee-460f-8f52-2daeda1a3232 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:55:35 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:55:35 user nova-compute[76161]:   <source dev="/dev/sdf"/>
Nov 14 17:55:35 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:55:35 user nova-compute[76161]:   <serial>4bcf4def-4d47-407e-9cb4-9aac3f2eac4f</serial>
Nov 14 17:55:35 user nova-compute[76161]: </disk>
Nov 14 17:55:35 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:55:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:55:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:55:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] No VIF found with MAC fa:16:3e:6b:99:82, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:55:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5c03a2d-61ff-4f16-b4bd-d4864ea09bc9 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.979s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.182s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Acquiring lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Acquiring lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:40 user nova-compute[76161]: INFO nova.compute.manager [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Terminating instance
Nov 14 17:55:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-e3595049-db09-446e-a2ad-9e886fc17672 req-74223e6c-270b-44db-92b3-8a58d01e847c service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Received event network-vif-unplugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e3595049-db09-446e-a2ad-9e886fc17672 req-74223e6c-270b-44db-92b3-8a58d01e847c service nova] Acquiring lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e3595049-db09-446e-a2ad-9e886fc17672 req-74223e6c-270b-44db-92b3-8a58d01e847c service nova] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e3595049-db09-446e-a2ad-9e886fc17672 req-74223e6c-270b-44db-92b3-8a58d01e847c service nova] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-e3595049-db09-446e-a2ad-9e886fc17672 req-74223e6c-270b-44db-92b3-8a58d01e847c service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] No waiting events found dispatching network-vif-unplugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-e3595049-db09-446e-a2ad-9e886fc17672 req-74223e6c-270b-44db-92b3-8a58d01e847c service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Received event network-vif-unplugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:55:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Instance destroyed successfully.
Nov 14 17:55:41 user nova-compute[76161]: DEBUG nova.objects.instance [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lazy-loading 'resources' on Instance uuid f0a6ae6f-72f6-4357-8fe6-a327549d1918 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1630376416',display_name='tempest-VolumesActionsTest-instance-1630376416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1630376416',id=20,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8d419b234844da882073df16f6d75dc',ramdisk_id='',reservation_id='r-gejbolhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1878791940',owner_user_name='tempest-VolumesActionsTest-1878791940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:53:53Z,user_data=None,user_id='87500058da4343af8a40e9ecb0045745',uuid=f0a6ae6f-72f6-4357-8fe6-a327549d1918,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "address": "fa:16:3e:9f:1d:1b", "network": {"id": "9216f93e-0899-4614-afae-cb11f4ce634e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-955733189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8d419b234844da882073df16f6d75dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3580c5a-1a", "ovs_interfaceid": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Converting VIF {"id": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "address": "fa:16:3e:9f:1d:1b", "network": {"id": "9216f93e-0899-4614-afae-cb11f4ce634e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-955733189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8d419b234844da882073df16f6d75dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3580c5a-1a", "ovs_interfaceid": "d3580c5a-1a9d-4342-8524-b95ba43e18b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:1d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d3580c5a-1a9d-4342-8524-b95ba43e18b8,network=Network(9216f93e-0899-4614-afae-cb11f4ce634e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3580c5a-1a') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG os_vif [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:1d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d3580c5a-1a9d-4342-8524-b95ba43e18b8,network=Network(9216f93e-0899-4614-afae-cb11f4ce634e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3580c5a-1a') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3580c5a-1a, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66b4b359-a8d3-4f0f-80b8-4aee31f380f6) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:41 user nova-compute[76161]: INFO os_vif [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:1d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d3580c5a-1a9d-4342-8524-b95ba43e18b8,network=Network(9216f93e-0899-4614-afae-cb11f4ce634e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3580c5a-1a')
Nov 14 17:55:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Deleting instance files /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918_del
Nov 14 17:55:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Deletion of /opt/stack/data/nova/instances/f0a6ae6f-72f6-4357-8fe6-a327549d1918_del complete
Nov 14 17:55:41 user nova-compute[76161]: INFO nova.compute.manager [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 14 17:55:41 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:55:41 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:42 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Took 1.17 seconds to deallocate network for instance.
Nov 14 17:55:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-bea61a91-f5df-48e8-b3c6-fea1d0a06a48 req-cdd994d5-540e-457a-8491-1578548ffcff service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Received event network-vif-deleted-d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:42 user nova-compute[76161]: INFO nova.compute.manager [req-bea61a91-f5df-48e8-b3c6-fea1d0a06a48 req-cdd994d5-540e-457a-8491-1578548ffcff service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Neutron deleted interface d3580c5a-1a9d-4342-8524-b95ba43e18b8; detaching it from the instance and deleting it from the info cache
Nov 14 17:55:42 user nova-compute[76161]: DEBUG nova.network.neutron [req-bea61a91-f5df-48e8-b3c6-fea1d0a06a48 req-cdd994d5-540e-457a-8491-1578548ffcff service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-bea61a91-f5df-48e8-b3c6-fea1d0a06a48 req-cdd994d5-540e-457a-8491-1578548ffcff service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Detach interface failed, port_id=d3580c5a-1a9d-4342-8524-b95ba43e18b8, reason: Instance f0a6ae6f-72f6-4357-8fe6-a327549d1918 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-23ee7fb6-aae4-49b0-90fb-3953307c0fc2 req-a3f12476-4010-4589-8e90-4df6518c628c service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Received event network-vif-plugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23ee7fb6-aae4-49b0-90fb-3953307c0fc2 req-a3f12476-4010-4589-8e90-4df6518c628c service nova] Acquiring lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23ee7fb6-aae4-49b0-90fb-3953307c0fc2 req-a3f12476-4010-4589-8e90-4df6518c628c service nova] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23ee7fb6-aae4-49b0-90fb-3953307c0fc2 req-a3f12476-4010-4589-8e90-4df6518c628c service nova] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-23ee7fb6-aae4-49b0-90fb-3953307c0fc2 req-a3f12476-4010-4589-8e90-4df6518c628c service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] No waiting events found dispatching network-vif-plugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:42 user nova-compute[76161]: WARNING nova.compute.manager [req-23ee7fb6-aae4-49b0-90fb-3953307c0fc2 req-a3f12476-4010-4589-8e90-4df6518c628c service nova] [instance: f0a6ae6f-72f6-4357-8fe6-a327549d1918] Received unexpected event network-vif-plugged-d3580c5a-1a9d-4342-8524-b95ba43e18b8 for instance with vm_state deleted and task_state None.
Nov 14 17:55:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:43 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Deleted allocations for instance f0a6ae6f-72f6-4357-8fe6-a327549d1918
Nov 14 17:55:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90c69300-2fbe-46f1-acc6-b07521d8bb16 tempest-VolumesActionsTest-1878791940 tempest-VolumesActionsTest-1878791940-project-member] Lock "f0a6ae6f-72f6-4357-8fe6-a327549d1918" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.473s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:43 user nova-compute[76161]: INFO nova.compute.manager [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Detaching volume 4bcf4def-4d47-407e-9cb4-9aac3f2eac4f
Nov 14 17:55:43 user nova-compute[76161]: INFO nova.virt.block_device [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Attempting to driver detach volume 4bcf4def-4d47-407e-9cb4-9aac3f2eac4f from mountpoint /dev/vdb
Nov 14 17:55:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Attempting to detach device vdb from instance a1ec772d-0eee-460f-8f52-2daeda1a3232 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:55:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:55:43 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:55:43 user nova-compute[76161]:   <source dev="/dev/sdf"/>
Nov 14 17:55:43 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:55:43 user nova-compute[76161]:   <serial>4bcf4def-4d47-407e-9cb4-9aac3f2eac4f</serial>
Nov 14 17:55:43 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:55:43 user nova-compute[76161]: </disk>
Nov 14 17:55:43 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:55:43 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Successfully detached device vdb from instance a1ec772d-0eee-460f-8f52-2daeda1a3232 from the persistent domain config.
Nov 14 17:55:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1ec772d-0eee-460f-8f52-2daeda1a3232 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:55:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:55:43 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:55:43 user nova-compute[76161]:   <source dev="/dev/sdf"/>
Nov 14 17:55:43 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:55:43 user nova-compute[76161]:   <serial>4bcf4def-4d47-407e-9cb4-9aac3f2eac4f</serial>
Nov 14 17:55:43 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:55:43 user nova-compute[76161]: </disk>
Nov 14 17:55:43 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:55:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1ec772d-0eee-460f-8f52-2daeda1a3232 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:55:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:50 user nova-compute[76161]: INFO nova.compute.manager [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Terminating instance
Nov 14 17:55:50 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-b600046d-7ce4-408b-aa8d-dd27d95e0eca req-8e23e027-fde2-4b3d-99e5-35b0b63daf90 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-unplugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b600046d-7ce4-408b-aa8d-dd27d95e0eca req-8e23e027-fde2-4b3d-99e5-35b0b63daf90 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b600046d-7ce4-408b-aa8d-dd27d95e0eca req-8e23e027-fde2-4b3d-99e5-35b0b63daf90 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b600046d-7ce4-408b-aa8d-dd27d95e0eca req-8e23e027-fde2-4b3d-99e5-35b0b63daf90 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-b600046d-7ce4-408b-aa8d-dd27d95e0eca req-8e23e027-fde2-4b3d-99e5-35b0b63daf90 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-unplugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-b600046d-7ce4-408b-aa8d-dd27d95e0eca req-8e23e027-fde2-4b3d-99e5-35b0b63daf90 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-unplugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Instance destroyed successfully.
Nov 14 17:55:51 user nova-compute[76161]: DEBUG nova.objects.instance [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lazy-loading 'resources' on Instance uuid b37a7f95-b429-431a-b837-a650fd1ee27e {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235698834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-235698834',id=16,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL15D+kMQspaKeW7+Bx5Dn7IFwRs/JMwFGq2/FmaQr23P9jWrQHvM1225hzBmTZF7rA/Hf1M98y9sJNaTlvjxHJCuE4gTpn+otFGMWDM/pMcafW1YhRqWDPdGRMGZKc0pw==',key_name='tempest-keypair-813492960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b442ba233de4096a5e0fa2e04d0853f',ramdisk_id='',reservation_id='r-qyf2fo90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-894639612',owner_user_name='tempest-TaggedAttachmentsTest-894639612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f77ddf30c3a4891991fd2bb6e95b297',uuid=b37a7f95-b429-431a-b837-a650fd1ee27e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converting VIF {"id": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "address": "fa:16:3e:9d:da:2c", "network": {"id": "b80a4ef5-f8e5-4dda-a07a-1f90e3e673be", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1347298581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b442ba233de4096a5e0fa2e04d0853f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc2c7fd-10", "ovs_interfaceid": "efc2c7fd-10f7-4ecc-a87d-c2f0c010d992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=efc2c7fd-10f7-4ecc-a87d-c2f0c010d992,network=Network(b80a4ef5-f8e5-4dda-a07a-1f90e3e673be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc2c7fd-10') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG os_vif [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=efc2c7fd-10f7-4ecc-a87d-c2f0c010d992,network=Network(b80a4ef5-f8e5-4dda-a07a-1f90e3e673be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc2c7fd-10') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefc2c7fd-10, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eba9b367-9a68-4435-a5f2-195c3050557e) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:55:51 user nova-compute[76161]: INFO os_vif [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=efc2c7fd-10f7-4ecc-a87d-c2f0c010d992,network=Network(b80a4ef5-f8e5-4dda-a07a-1f90e3e673be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc2c7fd-10')
Nov 14 17:55:51 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Deleting instance files /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e_del
Nov 14 17:55:51 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Deletion of /opt/stack/data/nova/instances/b37a7f95-b429-431a-b837-a650fd1ee27e_del complete
Nov 14 17:55:51 user nova-compute[76161]: INFO nova.compute.manager [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 17:55:51 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:52 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Took 0.97 seconds to deallocate network for instance.
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-da1f3f10-7188-4e11-8570-cd127ea34641 req-33329297-7bde-4485-b21f-401827c2a0ce service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-deleted-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:52 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Deleted allocations for instance b37a7f95-b429-431a-b837-a650fd1ee27e
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9d6ab92c-fa33-4980-82ea-6feaa1234bae tempest-TaggedAttachmentsTest-894639612 tempest-TaggedAttachmentsTest-894639612-project-member] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.376s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:52 user nova-compute[76161]: WARNING nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 for instance with vm_state deleted and task_state None.
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:52 user nova-compute[76161]: WARNING nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 for instance with vm_state deleted and task_state None.
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:52 user nova-compute[76161]: WARNING nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 for instance with vm_state deleted and task_state None.
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-unplugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-unplugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:52 user nova-compute[76161]: WARNING nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-unplugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 for instance with vm_state deleted and task_state None.
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Acquiring lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] Lock "b37a7f95-b429-431a-b837-a650fd1ee27e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] No waiting events found dispatching network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:52 user nova-compute[76161]: WARNING nova.compute.manager [req-954e78a3-ee3d-4034-a437-cc4208a1746c req-e63daf34-8d66-44be-a8e4-1de720567e50 service nova] [instance: b37a7f95-b429-431a-b837-a650fd1ee27e] Received unexpected event network-vif-plugged-efc2c7fd-10f7-4ecc-a87d-c2f0c010d992 for instance with vm_state deleted and task_state None.
Nov 14 17:55:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:55 user nova-compute[76161]: INFO nova.compute.manager [None req-e783e544-8cd7-41a3-85af-6c4a45e186c1 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Unrescuing
Nov 14 17:55:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e783e544-8cd7-41a3-85af-6c4a45e186c1 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:55:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e783e544-8cd7-41a3-85af-6c4a45e186c1 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquired lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:55:55 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e783e544-8cd7-41a3-85af-6c4a45e186c1 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e783e544-8cd7-41a3-85af-6c4a45e186c1 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updating instance_info_cache with network_info: [{"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e783e544-8cd7-41a3-85af-6c4a45e186c1 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Releasing lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e783e544-8cd7-41a3-85af-6c4a45e186c1 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'flavor' on Instance uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-13c30667-56ce-426a-aabd-8e8ec29c18c6 req-455e683f-43aa-4482-836c-fc4d70bd9769 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-unplugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13c30667-56ce-426a-aabd-8e8ec29c18c6 req-455e683f-43aa-4482-836c-fc4d70bd9769 service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13c30667-56ce-426a-aabd-8e8ec29c18c6 req-455e683f-43aa-4482-836c-fc4d70bd9769 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-13c30667-56ce-426a-aabd-8e8ec29c18c6 req-455e683f-43aa-4482-836c-fc4d70bd9769 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-13c30667-56ce-426a-aabd-8e8ec29c18c6 req-455e683f-43aa-4482-836c-fc4d70bd9769 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-unplugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:56 user nova-compute[76161]: WARNING nova.compute.manager [req-13c30667-56ce-426a-aabd-8e8ec29c18c6 req-455e683f-43aa-4482-836c-fc4d70bd9769 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-unplugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state rescued and task_state unrescuing.
Nov 14 17:55:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Instance destroyed successfully.
Nov 14 17:55:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-2fdd26a5-1153-49f8-b851-5face78b68c9 req-7a6be80b-ac87-4f60-99eb-673191266b59 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received event network-changed-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-2fdd26a5-1153-49f8-b851-5face78b68c9 req-7a6be80b-ac87-4f60-99eb-673191266b59 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Refreshing instance network info cache due to event network-changed-6c769206-c0b4-4709-bea6-76a2cc640a57. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2fdd26a5-1153-49f8-b851-5face78b68c9 req-7a6be80b-ac87-4f60-99eb-673191266b59 service nova] Acquiring lock "refresh_cache-fdcdc21a-3601-4f26-8da3-f345c35d839d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2fdd26a5-1153-49f8-b851-5face78b68c9 req-7a6be80b-ac87-4f60-99eb-673191266b59 service nova] Acquired lock "refresh_cache-fdcdc21a-3601-4f26-8da3-f345c35d839d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG nova.network.neutron [req-2fdd26a5-1153-49f8-b851-5face78b68c9 req-7a6be80b-ac87-4f60-99eb-673191266b59 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Refreshing network info cache for port 6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lazy-loading 'flavor' on Instance uuid fdcdc21a-3601-4f26-8da3-f345c35d839d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:57 user nova-compute[76161]: INFO nova.compute.manager [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Attaching volume 22e18660-e8f7-42ef-9f23-3167d20cafb8 to /dev/vdb
Nov 14 17:55:57 user nova-compute[76161]: DEBUG nova.network.neutron [req-2fdd26a5-1153-49f8-b851-5face78b68c9 req-7a6be80b-ac87-4f60-99eb-673191266b59 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Updated VIF entry in instance network info cache for port 6c769206-c0b4-4709-bea6-76a2cc640a57. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG nova.network.neutron [req-2fdd26a5-1153-49f8-b851-5face78b68c9 req-7a6be80b-ac87-4f60-99eb-673191266b59 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Updating instance_info_cache with network_info: [{"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG os_brick.utils [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2fdd26a5-1153-49f8-b851-5face78b68c9 req-7a6be80b-ac87-4f60-99eb-673191266b59 service nova] Releasing lock "refresh_cache-fdcdc21a-3601-4f26-8da3-f345c35d839d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[966d3377-61ce-4726-8bb5-3424720b378a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba894c3a-1044-4cf2-856a-ad72657867e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[10666a84-88af-4023-9b28-69eabdb50bd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2ea8f-894e-4a13-9483-c10be985d17d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:55:58 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:55:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b51eb1-b304-45ad-b224-f2493ac17970]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG os_brick.utils [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Updating existing volume attachment record: cc17627a-ffb3-4e25-b931-5bdd85927ce6 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:58 user nova-compute[76161]: WARNING nova.compute.manager [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state rescued and task_state unrescuing.
Nov 14 17:55:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:55:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:55:58 user nova-compute[76161]: WARNING nova.compute.manager [req-50f9d853-eaf4-482a-a1c0-34c1aea063e9 req-0e5de801-dbf6-4ac8-89b5-18d6f2e22c6e service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state rescued and task_state unrescuing.
Nov 14 17:55:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:55:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e783e544-8cd7-41a3-85af-6c4a45e186c1 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:56:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6128ca13-67d8-43d8-a9fd-ab1653dd9fa3 req-1736a597-8cba-46c2-94b2-5c88bf4c0d27 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:56:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6128ca13-67d8-43d8-a9fd-ab1653dd9fa3 req-1736a597-8cba-46c2-94b2-5c88bf4c0d27 service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6128ca13-67d8-43d8-a9fd-ab1653dd9fa3 req-1736a597-8cba-46c2-94b2-5c88bf4c0d27 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6128ca13-67d8-43d8-a9fd-ab1653dd9fa3 req-1736a597-8cba-46c2-94b2-5c88bf4c0d27 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-6128ca13-67d8-43d8-a9fd-ab1653dd9fa3 req-1736a597-8cba-46c2-94b2-5c88bf4c0d27 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:56:00 user nova-compute[76161]: WARNING nova.compute.manager [req-6128ca13-67d8-43d8-a9fd-ab1653dd9fa3 req-1736a597-8cba-46c2-94b2-5c88bf4c0d27 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state rescued and task_state unrescuing.
Nov 14 17:56:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRmzhHjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:02 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:02 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:02 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c1393f-4e62-44b2-be61-17180d3c5909]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:56:02 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81cfd2b-d4e9-4d40-9d2a-2af6613838c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8] added
Nov 14 17:56:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[152ea557-c1b9-4023-b037-d2956eac870d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e43c425-5ae3-4b50-a8f6-0d44901a9401]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRmzhHjx {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRmzhHjx" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a34935d-64df-4157-b732-df07454559cb]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SRmzhHjx'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a768037-9a00-4f18-a726-5938b6f8ef29]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f054414-0c11-4840-9d12-f618be40456e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)
Nov 14 17:56:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)
Nov 14 17:56:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00eb19d-f678-49b6-a8d2-a35c174485a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260]
Nov 14 17:56:02 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260] successful.
Nov 14 17:56:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e20569d-f26e-4993-9d9c-b861134e7470]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c09656-ba1b-4d36-8525-fe4333016e4e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)
Nov 14 17:56:02 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e19d721-a841-4312-958c-4253ef138bb8]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:56:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRmzhHjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:56:03 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1ec772d-0eee-460f-8f52-2daeda1a3232 is timed out.
Nov 14 17:56:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Successfully detached device vdb from instance a1ec772d-0eee-460f-8f52-2daeda1a3232 from the live domain config.
Nov 14 17:56:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOEHkjNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:03 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23762306237353065', 'path': '/dev/sdg'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762306237353065', 'path': '/dev/sdg'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lazy-loading 'flavor' on Instance uuid fdcdc21a-3601-4f26-8da3-f345c35d839d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[35135cd1-7677-4964-82d7-e85d7cd1a20e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:56:03 user nova-compute[76161]: No targets found.
Nov 14 17:56:03 user nova-compute[76161]: iSNS:
Nov 14 17:56:03 user nova-compute[76161]: No targets found.
Nov 14 17:56:03 user nova-compute[76161]: STATIC:
Nov 14 17:56:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f
Nov 14 17:56:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8
Nov 14 17:56:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:56:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:56:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:56:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8
Nov 14 17:56:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:03 user nova-compute[76161]: FIRMWARE:
Nov 14 17:56:03 user nova-compute[76161]: No targets found.
Nov 14 17:56:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:56:03 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:56:03 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:56:03 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:56:03 user nova-compute[76161]:   <source dev="/dev/sdg"/>
Nov 14 17:56:03 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:56:03 user nova-compute[76161]:   <serial>22e18660-e8f7-42ef-9f23-3167d20cafb8</serial>
Nov 14 17:56:03 user nova-compute[76161]: </disk>
Nov 14 17:56:03 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a2a1f4-0881-41ac-bf2a-57aefd463315]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0610ce35-9cb6-4998-b827-070ec4459fea]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:03 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:03 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:03 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:03 user nova-compute[76161]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)
Nov 14 17:56:03 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:03 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:03 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:03 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:03 user nova-compute[76161]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f (non-flash)
Nov 14 17:56:03 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f03b03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f'): ({'sdf'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Removing single pathed devices sdf {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e691917-ee39-4a4a-9c86-6d7807bfa060]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c20c10-2b76-41a9-8d03-b4de1815b85c]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Flushing IO for device /dev/sdf {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f5c5a0-0df0-4f9e-b5db-10d433b7927e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2907f5b2-77c2-40f3-8f35-3779ba6f7f40]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee0296-f114-4589-b99e-61046a955521]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4510524-7444-44c0-a323-1e479ff5fc97]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f, portal: 172.16.0.220,3260]
Nov 14 17:56:04 user nova-compute[76161]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f, portal: 172.16.0.220,3260] successful.
Nov 14 17:56:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[69028e27-b445-47cf-91b3-e04d57266d6b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] <== disconnect_volume: return (343ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] No VIF found with MAC fa:16:3e:ef:c5:37, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2621688c-113a-47df-a03b-ce8fdeb9f1c1 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.483s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lazy-loading 'flavor' on Instance uuid a1ec772d-0eee-460f-8f52-2daeda1a3232 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d0fae5df-6780-42ec-9d7f-4a4908c96b00 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.626s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:04 user nova-compute[76161]: INFO nova.compute.manager [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Terminating instance
Nov 14 17:56:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-0840c81c-4bf9-42d6-bd0a-195bd59dbf61 req-2ee27d11-82dc-4b8a-b97b-86c104cd674c service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received event network-vif-unplugged-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0840c81c-4bf9-42d6-bd0a-195bd59dbf61 req-2ee27d11-82dc-4b8a-b97b-86c104cd674c service nova] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0840c81c-4bf9-42d6-bd0a-195bd59dbf61 req-2ee27d11-82dc-4b8a-b97b-86c104cd674c service nova] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0840c81c-4bf9-42d6-bd0a-195bd59dbf61 req-2ee27d11-82dc-4b8a-b97b-86c104cd674c service nova] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-0840c81c-4bf9-42d6-bd0a-195bd59dbf61 req-2ee27d11-82dc-4b8a-b97b-86c104cd674c service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] No waiting events found dispatching network-vif-unplugged-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-0840c81c-4bf9-42d6-bd0a-195bd59dbf61 req-2ee27d11-82dc-4b8a-b97b-86c104cd674c service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received event network-vif-unplugged-ea45b27f-34f8-4051-98f1-486c4f32d35a for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Instance destroyed successfully.
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.objects.instance [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lazy-loading 'resources' on Instance uuid a1ec772d-0eee-460f-8f52-2daeda1a3232 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1269380355',display_name='tempest-VolumesSnapshotTestJSON-instance-1269380355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1269380355',id=19,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9zPKRGudfhPVzZH9x7YGG2DsaymnmsYFtlSC9x0PpTLea1aTHyEo2VMf6NSOnVvmZR7qKxcEs/EKAEx67O1qWlXqOZ3m38Hb40lJkPJ0BHjD44B2TIHfvn3OkaBkNW0w==',key_name='tempest-keypair-1018080940',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec9d6960a8574bf5879639b40b156a86',ramdisk_id='',reservation_id='r-ire3azie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-688447987',owner_user_name='tempest-VolumesSnapshotTestJSON-688447987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='470be45a97bd464b9d22b2fb6f97cf95',uuid=a1ec772d-0eee-460f-8f52-2daeda1a3232,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converting VIF {"id": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "address": "fa:16:3e:6b:99:82", "network": {"id": "11f84ab6-c592-42f2-a7ce-4311bf71ba36", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-877073461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec9d6960a8574bf5879639b40b156a86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea45b27f-34", "ovs_interfaceid": "ea45b27f-34f8-4051-98f1-486c4f32d35a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:99:82,bridge_name='br-int',has_traffic_filtering=True,id=ea45b27f-34f8-4051-98f1-486c4f32d35a,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea45b27f-34') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_vif [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:99:82,bridge_name='br-int',has_traffic_filtering=True,id=ea45b27f-34f8-4051-98f1-486c4f32d35a,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea45b27f-34') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea45b27f-34, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4acb80a-67ce-44e2-a895-d725cdd10acd) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:05 user nova-compute[76161]: INFO os_vif [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:99:82,bridge_name='br-int',has_traffic_filtering=True,id=ea45b27f-34f8-4051-98f1-486c4f32d35a,network=Network(11f84ab6-c592-42f2-a7ce-4311bf71ba36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea45b27f-34')
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOEHkjNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:05 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a60e66-ba41-4882-af88-03496d0a53ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:56:05 user nova-compute[76161]: No targets found.
Nov 14 17:56:05 user nova-compute[76161]: iSNS:
Nov 14 17:56:05 user nova-compute[76161]: No targets found.
Nov 14 17:56:05 user nova-compute[76161]: STATIC:
Nov 14 17:56:05 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8
Nov 14 17:56:05 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:05 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:05 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:56:05 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:05 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:05 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:56:05 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:05 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:05 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:56:05 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:05 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:05 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8
Nov 14 17:56:05 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:05 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:05 user nova-compute[76161]: FIRMWARE:
Nov 14 17:56:05 user nova-compute[76161]: No targets found.
Nov 14 17:56:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:56:05 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:56:05 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bcf4def-4d47-407e-9cb4-9aac3f2eac4f', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf9a5af-a35b-4451-87f6-22e561fe6845]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd4102-05a6-482c-8300-41dc6c7499af]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:05 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:05 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:05 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:05 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:05 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:05 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:05 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:05 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0173520>, {}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Disconnecting from: [] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] <== disconnect_volume: return (91ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:56:05 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Deleting instance files /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232_del
Nov 14 17:56:05 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Deletion of /opt/stack/data/nova/instances/a1ec772d-0eee-460f-8f52-2daeda1a3232_del complete
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:05 user nova-compute[76161]: INFO nova.compute.manager [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.utils [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefb1473-a92f-4be9-a710-b20d55a33a2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[626ce306-5e1e-4edf-943a-6e5df2a4776e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f4f7e-3390-4c46-8e65-6a4418095e7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7502820-dc08-45df-a4f7-6994f3f330af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:56:05 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:56:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[40809a12-0fea-4973-bca7-ba60f1c97c48]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:56:05 user nova-compute[76161]: DEBUG os_brick.utils [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:06 user nova-compute[76161]: INFO nova.compute.manager [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Swapping volume 22e18660-e8f7-42ef-9f23-3167d20cafb8 for 5050638e-dce7-478e-9e3e-7213c85ae935
Nov 14 17:56:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-6068a8ce-95ff-4b97-8bb3-cf32970873d4 req-fc0f5eea-959f-4637-82ab-0edb2a326f19 service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received event network-vif-plugged-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:56:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6068a8ce-95ff-4b97-8bb3-cf32970873d4 req-fc0f5eea-959f-4637-82ab-0edb2a326f19 service nova] Acquiring lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6068a8ce-95ff-4b97-8bb3-cf32970873d4 req-fc0f5eea-959f-4637-82ab-0edb2a326f19 service nova] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6068a8ce-95ff-4b97-8bb3-cf32970873d4 req-fc0f5eea-959f-4637-82ab-0edb2a326f19 service nova] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-6068a8ce-95ff-4b97-8bb3-cf32970873d4 req-fc0f5eea-959f-4637-82ab-0edb2a326f19 service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] No waiting events found dispatching network-vif-plugged-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:56:07 user nova-compute[76161]: WARNING nova.compute.manager [req-6068a8ce-95ff-4b97-8bb3-cf32970873d4 req-fc0f5eea-959f-4637-82ab-0edb2a326f19 service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received unexpected event network-vif-plugged-ea45b27f-34f8-4051-98f1-486c4f32d35a for instance with vm_state active and task_state deleting.
Nov 14 17:56:07 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:56:07 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Took 1.64 seconds to deallocate network for instance.
Nov 14 17:56:07 user nova-compute[76161]: WARNING nova.volume.cinder [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Attachment 02490c7a-bb6f-4350-acd9-b1f4cc453250 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 02490c7a-bb6f-4350-acd9-b1f4cc453250. (HTTP 404) (Request-ID: req-7d9f2d17-2c40-4184-b26a-11b9344b0ebe)
Nov 14 17:56:07 user nova-compute[76161]: INFO nova.compute.manager [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 17:56:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:07 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:56:07 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:56:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:08 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Deleted allocations for instance a1ec772d-0eee-460f-8f52-2daeda1a3232
Nov 14 17:56:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fc06f713-b4e5-40fc-a6ba-8f65e85abe87 tempest-VolumesSnapshotTestJSON-688447987 tempest-VolumesSnapshotTestJSON-688447987-project-member] Lock "a1ec772d-0eee-460f-8f52-2daeda1a3232" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.239s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-30fce7be-99ea-49e5-9f39-1d65f7f38bee req-dbd898eb-ac81-44a1-b2d4-87aa65d1fd50 service nova] [instance: a1ec772d-0eee-460f-8f52-2daeda1a3232] Received event network-vif-deleted-ea45b27f-34f8-4051-98f1-486c4f32d35a {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgONTubH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdcdc21a-3601-4f26-8da3-f345c35d839d', 'attached_at': '', 'detached_at': '', 'volume_id': '5050638e-dce7-478e-9e3e-7213c85ae935', 'serial': '5050638e-dce7-478e-9e3e-7213c85ae935'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRmzhHjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'fdcdc21a-3601-4f26-8da3-f345c35d839d', 'attached_at': '', 'detached_at': '', 'volume_id': '22e18660-e8f7-42ef-9f23-3167d20cafb8', 'serial'} {{(pid=76161) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgONTubH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:10 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:10 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:10 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a99302-0e03-4616-ae95-6baa511abd20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:56:10 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f25b89-b89c-4c8a-8ebf-820b21baf99f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935] added
Nov 14 17:56:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a14cdba-5be1-46ea-9f8c-683cecc2f032]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cd5560-0e93-4c47-8a49-1f02b0504971]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgONTubH {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgONTubH" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b92ae93-ffff-4f25-a7c8-9a7ec49de275]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XgONTubH'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec569883-b6ef-4b25-bb6a-d62b0113f9a4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b1dacc-c36c-4025-a54b-7125bcaff7f9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0450d51b-6b17-439b-a1e2-ef5c90463cfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935, portal: 172.16.0.220,3260]
Nov 14 17:56:10 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935, portal: 172.16.0.220,3260] successful.
Nov 14 17:56:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[611471ab-eccd-4f3f-bf0c-be969a41acc5]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae66eab-9bca-4ab5-abd3-89bf0e9f39c8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)
Nov 14 17:56:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95b2ffe-eaae-464b-9515-5276294592b6]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:10 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:56:11 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:56:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:56:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgONTubH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:56:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26164303637613038', 'path': '/dev/sdf'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164303637613038', 'path': '/dev/sdf'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:56:11 user nova-compute[76161]: DEBUG nova.objects.instance [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lazy-loading 'flavor' on Instance uuid fdcdc21a-3601-4f26-8da3-f345c35d839d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 159383552 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Updating instance_info_cache with network_info: [{"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:56:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:56:13 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:56:13 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:56:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 276824064 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 435159040 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:14 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:56:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 597688320 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 756023296 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 933232640 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRmzhHjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:15 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8efe4c3-064c-4e03-b53a-50ba1ea3dee3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:56:15 user nova-compute[76161]: No targets found.
Nov 14 17:56:15 user nova-compute[76161]: iSNS:
Nov 14 17:56:15 user nova-compute[76161]: No targets found.
Nov 14 17:56:15 user nova-compute[76161]: STATIC:
Nov 14 17:56:15 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8
Nov 14 17:56:15 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:15 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:15 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:56:15 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:15 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:15 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:56:15 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:15 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:15 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:56:15 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:15 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:15 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8
Nov 14 17:56:15 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:15 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:15 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935
Nov 14 17:56:15 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:15 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:15 user nova-compute[76161]: FIRMWARE:
Nov 14 17:56:15 user nova-compute[76161]: No targets found.
Nov 14 17:56:15 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:56:15 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:56:15 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:56:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0629cc26-44e6-4755-bcfd-32d367c7764b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d85634-909f-46da-aadc-d1f886b60981]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:16 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:16 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:16 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:16 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:16 user nova-compute[76161]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)
Nov 14 17:56:16 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:16 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:16 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:16 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:16 user nova-compute[76161]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:16 user nova-compute[76161]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)
Nov 14 17:56:16 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0170310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8'): ({'sdg'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Removing single pathed devices sdg {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e3536d-9a57-49db-bf34-a9e310a552e5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8715cabe-464c-4f9f-bd2c-7d5af3d42783]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Flushing IO for device /dev/sdg {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7ec4cb-691a-4859-a150-83b8e3e37afd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d2ec1f-73e1-43c4-a871-8113f49d4a8c]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] SCSI volumes sdg have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e16196-29da-4f1d-8fb3-1f20087dee79]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1574cebc-c367-4ea8-b0d1-44b697594f40]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260]
Nov 14 17:56:16 user nova-compute[76161]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260] successful.
Nov 14 17:56:16 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[51af5be1-e67e-49ef-92c1-d23db8f5a1d8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] <== disconnect_volume: return (313ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgONTubH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'fdcdc21a-3601-4f26-8da3-f345c35d839d', 'attached_at': '', 'detached_at': '', 'volume_id': '5050638e-dce7-478e-9e3e-7213c85ae935', 'serial'} {{(pid=76161) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 17:56:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] swap_volume: removing Cinder connection for volume 22e18660-e8f7-42ef-9f23-3167d20cafb8 {{(pid=76161) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 17:56:17 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] swap_volume: Updating volume 22e18660-e8f7-42ef-9f23-3167d20cafb8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "XgONTubH", "auth_password": "x8cAQ9JiHwIFWS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "5050638e-dce7-478e-9e3e-7213c85ae935"}, "status": "reserved", "instance": "fdcdc21a-3601-4f26-8da3-f345c35d839d", "attached_at": "", "detached_at": "", "volume_id": "5050638e-dce7-478e-9e3e-7213c85ae935", "serial": "5050638e-dce7-478e-9e3e-7213c85ae935"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5050638e-dce7-478e-9e3e-7213c85ae935', 'no_device': None, 'attachment_id': '64fd1eb6-5cfc-407d-aeef-b0e5ff38f380'} {{(pid=76161) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 17:56:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b540abab-ea5b-4a5e-a337-3b6363a1f172 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.240s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG os_brick.utils [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[98142a58-104a-4849-a186-1995a5ca4f80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbd99df-f5e3-4072-86a3-1ac08d61e5d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57f668-d3e4-44bc-84f9-c92ad3ea8922]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8588e2-4718-4311-a10b-9cc032b38b9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:56:18 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4972d6-0e77-4160-b304-46b46964fb2d]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG os_brick.utils [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:18 user nova-compute[76161]: INFO nova.compute.manager [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Swapping volume 5050638e-dce7-478e-9e3e-7213c85ae935 for 22e18660-e8f7-42ef-9f23-3167d20cafb8
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:56:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:56:22 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:56:22 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7362MB free_disk=25.305370330810547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56848a92-97b3-4eef-b924-de8ab85ad115 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56f47238-81fe-4196-865c-e1ad68cf6fea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 76193048-410d-4a59-9eb5-165d8ce0af6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance fdcdc21a-3601-4f26-8da3-f345c35d839d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 7eeac8f5-64d4-4da0-817f-376603bb54a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRmzhHjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdcdc21a-3601-4f26-8da3-f345c35d839d', 'attached_at': '', 'detached_at': '', 'volume_id': '22e18660-e8f7-42ef-9f23-3167d20cafb8', 'serial': '22e18660-e8f7-42ef-9f23-3167d20cafb8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgONTubH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '5050638e-dce7-478e-9e3e-7213c85ae935'}, 'status': 'reserved', 'instance': 'fdcdc21a-3601-4f26-8da3-f345c35d839d', 'attached_at': '', 'detached_at': '', 'volume_id': '5050638e-dce7-478e-9e3e-7213c85ae935', 'serial'} {{(pid=76161) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRmzhHjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:22 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:22 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:22 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee3479c-4ae8-496f-a16f-8cc43fc11578]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:56:22 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e04d359-b97d-48b2-8c73-d57b8ebc4d07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8] added
Nov 14 17:56:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3949eb1d-aed9-4571-aaa2-eb15a99c7d26]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff7b322-ce51-4996-9cf9-df6a211e7aea]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRmzhHjx {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRmzhHjx" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e74b673-7ffd-4552-85b8-eb99d8603667]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SRmzhHjx'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb681136-cb58-40de-9428-d72c4d5ed816]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b88c518-e709-4f73-8803-ae3225ca8e89]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:22 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:22 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:22 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:22 user nova-compute[76161]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)
Nov 14 17:56:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:22 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:22 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:22 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:22 user nova-compute[76161]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)
Nov 14 17:56:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dcb928-d2af-48c4-8054-09ecf8265dbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260]
Nov 14 17:56:23 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260] successful.
Nov 14 17:56:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e988a01-a6c4-49ac-9803-dc10f243f058]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[374c4aac-2ce1-4dfe-ba69-333e83609aea]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:23 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:23 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:23 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:23 user nova-compute[76161]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)
Nov 14 17:56:23 user nova-compute[76161]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:23 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:23 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:23 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:23 user nova-compute[76161]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)
Nov 14 17:56:23 user nova-compute[76161]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.049s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5e590d-fd03-4f13-9e37-7c5503578ca6]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:56:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRmzhHjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:56:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23762306237353065', 'path': '/dev/sdg'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762306237353065', 'path': '/dev/sdg'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:56:24 user nova-compute[76161]: DEBUG nova.objects.instance [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lazy-loading 'flavor' on Instance uuid fdcdc21a-3601-4f26-8da3-f345c35d839d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:56:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 135266304 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 283115520 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 421527552 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 551550976 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 736100352 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 911212544 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgONTubH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '5050638e-dce7-478e-9e3e-7213c85ae935'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:28 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8746a9df-aad9-4f69-a0a7-1f4b7c80457b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:56:28 user nova-compute[76161]: No targets found.
Nov 14 17:56:28 user nova-compute[76161]: iSNS:
Nov 14 17:56:28 user nova-compute[76161]: No targets found.
Nov 14 17:56:28 user nova-compute[76161]: STATIC:
Nov 14 17:56:28 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8
Nov 14 17:56:28 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:28 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:28 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:56:28 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:28 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:28 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:56:28 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:28 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:28 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:56:28 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:28 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:28 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8
Nov 14 17:56:28 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:28 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:28 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935
Nov 14 17:56:28 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:28 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:28 user nova-compute[76161]: FIRMWARE:
Nov 14 17:56:28 user nova-compute[76161]: No targets found.
Nov 14 17:56:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:56:28 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:56:28 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41e1ba4-0ca4-48a7-8d08-e329d3b993dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8d3cd1-da0d-4297-87e2-a5c6c38db0e6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:28 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:28 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:28 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:28 user nova-compute[76161]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)
Nov 14 17:56:28 user nova-compute[76161]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:28 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:28 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:28 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:28 user nova-compute[76161]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 (non-flash)
Nov 14 17:56:28 user nova-compute[76161]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d07c5240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935'): ({'sdf'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Removing single pathed devices sdf {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eb4be7-85a0-4ba8-9989-492b3323e2ab]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edc5c5f-2aac-48e8-ab45-df680743d1b1]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Flushing IO for device /dev/sdf {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb99333-282c-4ab6-a9e8-1bd969a7ff5f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[38842cba-475c-4ae2-9025-32a41f9b9218]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[246ac66c-51e7-4f06-b364-ae3aa9c4c068]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfcbcb3-f44b-4827-9f50-1b88375b6d7b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935, portal: 172.16.0.220,3260]
Nov 14 17:56:28 user nova-compute[76161]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935, portal: 172.16.0.220,3260] successful.
Nov 14 17:56:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050638e-dce7-478e-9e3e-7213c85ae935 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f706c9fa-12a1-44e1-9b7f-0a3a422998d3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] <== disconnect_volume: return (334ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRmzhHjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'fdcdc21a-3601-4f26-8da3-f345c35d839d', 'attached_at': '', 'detached_at': '', 'volume_id': '22e18660-e8f7-42ef-9f23-3167d20cafb8', 'serial'} {{(pid=76161) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 17:56:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] swap_volume: removing Cinder connection for volume 5050638e-dce7-478e-9e3e-7213c85ae935 {{(pid=76161) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 17:56:29 user nova-compute[76161]: DEBUG nova.compute.manager [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] swap_volume: Updating volume 5050638e-dce7-478e-9e3e-7213c85ae935 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "SRmzhHjx", "auth_password": "lAECurzKV81HNi", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "22e18660-e8f7-42ef-9f23-3167d20cafb8"}, "status": "reserved", "instance": "fdcdc21a-3601-4f26-8da3-f345c35d839d", "attached_at": "", "detached_at": "", "volume_id": "22e18660-e8f7-42ef-9f23-3167d20cafb8", "serial": "22e18660-e8f7-42ef-9f23-3167d20cafb8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '22e18660-e8f7-42ef-9f23-3167d20cafb8', 'no_device': None, 'attachment_id': 'a5923cc8-e873-4d89-89b9-5a7570e37f47'} {{(pid=76161) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 17:56:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-831154d2-cb13-4585-be28-88051c4daad6 tempest-TestVolumeSwap-86903314 tempest-TestVolumeSwap-86903314-project-admin] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.447s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:30 user nova-compute[76161]: INFO nova.compute.manager [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Detaching volume 22e18660-e8f7-42ef-9f23-3167d20cafb8
Nov 14 17:56:30 user nova-compute[76161]: INFO nova.virt.block_device [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Attempting to driver detach volume 22e18660-e8f7-42ef-9f23-3167d20cafb8 from mountpoint /dev/vdb
Nov 14 17:56:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Attempting to detach device vdb from instance fdcdc21a-3601-4f26-8da3-f345c35d839d from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:56:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:56:30 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:56:30 user nova-compute[76161]:   <source dev="/dev/sdg"/>
Nov 14 17:56:30 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:56:30 user nova-compute[76161]:   <serial>22e18660-e8f7-42ef-9f23-3167d20cafb8</serial>
Nov 14 17:56:30 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:56:30 user nova-compute[76161]: </disk>
Nov 14 17:56:30 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:56:30 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Successfully detached device vdb from instance fdcdc21a-3601-4f26-8da3-f345c35d839d from the persistent domain config.
Nov 14 17:56:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fdcdc21a-3601-4f26-8da3-f345c35d839d from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:56:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:56:30 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:56:30 user nova-compute[76161]:   <source dev="/dev/sdg"/>
Nov 14 17:56:30 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:56:30 user nova-compute[76161]:   <serial>22e18660-e8f7-42ef-9f23-3167d20cafb8</serial>
Nov 14 17:56:30 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:56:30 user nova-compute[76161]: </disk>
Nov 14 17:56:30 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:56:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fdcdc21a-3601-4f26-8da3-f345c35d839d {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:56:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:56:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:56:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-865bce68-5bc8-424d-9454-8308a53bd4c2 req-6327c50c-4944-4bfe-bbb8-743aeb408a36 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received event network-changed-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:56:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-865bce68-5bc8-424d-9454-8308a53bd4c2 req-6327c50c-4944-4bfe-bbb8-743aeb408a36 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Refreshing instance network info cache due to event network-changed-69b8f81e-f7ba-4056-ba8b-5493d55616c8. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:56:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-865bce68-5bc8-424d-9454-8308a53bd4c2 req-6327c50c-4944-4bfe-bbb8-743aeb408a36 service nova] Acquiring lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:56:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-865bce68-5bc8-424d-9454-8308a53bd4c2 req-6327c50c-4944-4bfe-bbb8-743aeb408a36 service nova] Acquired lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:56:49 user nova-compute[76161]: DEBUG nova.network.neutron [req-865bce68-5bc8-424d-9454-8308a53bd4c2 req-6327c50c-4944-4bfe-bbb8-743aeb408a36 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Refreshing network info cache for port 69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:56:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:49 user nova-compute[76161]: DEBUG nova.objects.instance [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lazy-loading 'flavor' on Instance uuid 6e87b617-e12f-4c33-bd5d-8f1bc07c417b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:56:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG nova.network.neutron [req-865bce68-5bc8-424d-9454-8308a53bd4c2 req-6327c50c-4944-4bfe-bbb8-743aeb408a36 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updated VIF entry in instance network info cache for port 69b8f81e-f7ba-4056-ba8b-5493d55616c8. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG nova.network.neutron [req-865bce68-5bc8-424d-9454-8308a53bd4c2 req-6327c50c-4944-4bfe-bbb8-743aeb408a36 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updating instance_info_cache with network_info: [{"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-865bce68-5bc8-424d-9454-8308a53bd4c2 req-6327c50c-4944-4bfe-bbb8-743aeb408a36 service nova] Releasing lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:50 user nova-compute[76161]: INFO nova.compute.manager [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Attaching volume 258b3fe8-bc78-4441-bdd3-76b2a87b4140 to /dev/vdb
Nov 14 17:56:50 user nova-compute[76161]: DEBUG os_brick.utils [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5361ab-d825-41b5-9458-1b61aa23d7f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[910ce160-2f60-40a6-b5d7-ed1c8a31ae13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e973c4-6d97-4305-a1bd-c831e4702f07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6f7fd2-d54a-447f-b8e2-9e4e255f0bf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:56:50 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f49e3e-300e-44fc-8444-2c2a786aeadb]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG os_brick.utils [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updating existing volume attachment record: 760267cc-e087-42e4-b323-c6b63c234d14 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:50 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fdcdc21a-3601-4f26-8da3-f345c35d839d is timed out.
Nov 14 17:56:50 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Successfully detached device vdb from instance fdcdc21a-3601-4f26-8da3-f345c35d839d from the live domain config.
Nov 14 17:56:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRmzhHjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '22e18660-e8f7-42ef-9f23-3167d20cafb8'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:50 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f4c96d-0802-473f-b984-a726b06a62c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:56:51 user nova-compute[76161]: No targets found.
Nov 14 17:56:51 user nova-compute[76161]: iSNS:
Nov 14 17:56:51 user nova-compute[76161]: No targets found.
Nov 14 17:56:51 user nova-compute[76161]: STATIC:
Nov 14 17:56:51 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8
Nov 14 17:56:51 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:51 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:51 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:56:51 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:51 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:51 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:56:51 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:51 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:51 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:56:51 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:51 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:51 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8
Nov 14 17:56:51 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:56:51 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:56:51 user nova-compute[76161]: FIRMWARE:
Nov 14 17:56:51 user nova-compute[76161]: No targets found.
Nov 14 17:56:51 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:56:51 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:56:51 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba436dd7-a187-4810-9a15-5661d2e70f51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[271a27d4-bf8a-4729-8a55-3a00bc9fdf27]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:51 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:51 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:51 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:51 user nova-compute[76161]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:51 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:51 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:51 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:51 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:51 user nova-compute[76161]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 (non-flash)
Nov 14 17:56:51 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d07c6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8'): ({'sdg'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Removing single pathed devices sdg {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[017e2afb-4581-4f58-882b-abad6da7f15a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[30761008-16fb-4e96-8807-da2bff6e74ad]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Flushing IO for device /dev/sdg {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd30abe-fc38-4589-a39c-3447d7bb783a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3f468b-011b-4269-aca9-31b745816f49]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] SCSI volumes sdg have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[615e397b-9e1b-4152-bbce-745e7058328f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[943f7992-2860-4d4f-a404-71734962ce85]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260]
Nov 14 17:56:51 user nova-compute[76161]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8, portal: 172.16.0.220,3260] successful.
Nov 14 17:56:51 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22e18660-e8f7-42ef-9f23-3167d20cafb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[045cdca8-c648-4eb4-97ca-c08d41817043]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] <== disconnect_volume: return (357ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:56:52 user nova-compute[76161]: DEBUG nova.objects.instance [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lazy-loading 'flavor' on Instance uuid fdcdc21a-3601-4f26-8da3-f345c35d839d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:56:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f3c5793b-7e25-4f04-a16b-f12a0a17af98 tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.937s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StesAolq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:56:55 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:55 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:56:55 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a1fc33-69c7-4846-bcb1-19af52f53a9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:56:55 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c18d1e-2b21-4c14-8805-831b321c97b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140] added
Nov 14 17:56:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6d20ae-70ea-4c79-96b5-1fe8e3886654]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[82297960-90c3-4bbd-a457-13b14a56c458]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StesAolq {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StesAolq" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4123e5ae-a7e0-4784-84a7-e2a43138d156]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'StesAolq'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb48a7ab-589c-4431-a420-e585c8844516]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fea88e-48f6-447f-9b1a-6389679c6157]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f17476-8b76-4d3c-a767-51ec6a38b2b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140, portal: 172.16.0.220,3260]
Nov 14 17:56:55 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140, portal: 172.16.0.220,3260] successful.
Nov 14 17:56:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ac27c4-2b03-4173-a75b-798bf4b6b1bd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9eaab31-bc46-4f30-8c50-b05718482f7e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 (non-flash)
Nov 14 17:56:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9d8c05-0378-4709-9680-450fa45d7454]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:56:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StesAolq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:56:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:56:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26433353661396162', 'path': '/dev/sdf'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:56:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433353661396162', 'path': '/dev/sdf'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:56:56 user nova-compute[76161]: DEBUG nova.objects.instance [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lazy-loading 'flavor' on Instance uuid 6e87b617-e12f-4c33-bd5d-8f1bc07c417b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:56:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:56:57 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:56:57 user nova-compute[76161]:   <source dev="/dev/sdf"/>
Nov 14 17:56:57 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:56:57 user nova-compute[76161]:   <serial>258b3fe8-bc78-4441-bdd3-76b2a87b4140</serial>
Nov 14 17:56:57 user nova-compute[76161]: </disk>
Nov 14 17:56:57 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:56:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:56:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:56:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] No VIF found with MAC fa:16:3e:9b:b5:e3, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:56:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-342511de-3b07-4b22-bae9-e654fe451269 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.497s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:56:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:56:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:56:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:56:59 user nova-compute[76161]: INFO nova.compute.manager [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Detaching volume 258b3fe8-bc78-4441-bdd3-76b2a87b4140
Nov 14 17:56:59 user nova-compute[76161]: INFO nova.virt.block_device [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Attempting to driver detach volume 258b3fe8-bc78-4441-bdd3-76b2a87b4140 from mountpoint /dev/vdb
Nov 14 17:56:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Attempting to detach device vdb from instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:56:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:56:59 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:56:59 user nova-compute[76161]:   <source dev="/dev/sdf"/>
Nov 14 17:56:59 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:56:59 user nova-compute[76161]:   <serial>258b3fe8-bc78-4441-bdd3-76b2a87b4140</serial>
Nov 14 17:56:59 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:56:59 user nova-compute[76161]: </disk>
Nov 14 17:56:59 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:56:59 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Successfully detached device vdb from instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b from the persistent domain config.
Nov 14 17:56:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:56:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:56:59 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:56:59 user nova-compute[76161]:   <source dev="/dev/sdf"/>
Nov 14 17:56:59 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:56:59 user nova-compute[76161]:   <serial>258b3fe8-bc78-4441-bdd3-76b2a87b4140</serial>
Nov 14 17:56:59 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:56:59 user nova-compute[76161]: </disk>
Nov 14 17:56:59 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:57:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:57:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:57:07 user nova-compute[76161]: INFO nova.compute.claims [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Claim successful on node user
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.network.neutron [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:57:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.policy [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89b7172f3aea4ef29587ca01c39be2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0413439dcb2e49d496bf267c63163178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:57:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Creating image(s)
Nov 14 17:57:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "/opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "/opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "/opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.190s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk 1073741824" returned: 0 in 0.050s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG nova.network.neutron [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Successfully created port: d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Cannot resize image /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Ensure instance console log exists: /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Successfully updated port: d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:57:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquired lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:57:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-fd5f8d9c-ea6b-4735-b49f-3c6452dc7a98 req-40b05bfa-6259-4028-bd83-e7439354fd01 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-changed-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-fd5f8d9c-ea6b-4735-b49f-3c6452dc7a98 req-40b05bfa-6259-4028-bd83-e7439354fd01 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Refreshing instance network info cache due to event network-changed-d9c3c5f8-f77b-4475-9693-c63f6e310d19. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:57:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fd5f8d9c-ea6b-4735-b49f-3c6452dc7a98 req-40b05bfa-6259-4028-bd83-e7439354fd01 service nova] Acquiring lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:09 user nova-compute[76161]: DEBUG nova.network.neutron [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.network.neutron [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updating instance_info_cache with network_info: [{"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Releasing lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance network_info: |[{"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fd5f8d9c-ea6b-4735-b49f-3c6452dc7a98 req-40b05bfa-6259-4028-bd83-e7439354fd01 service nova] Acquired lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.network.neutron [req-fd5f8d9c-ea6b-4735-b49f-3c6452dc7a98 req-40b05bfa-6259-4028-bd83-e7439354fd01 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Refreshing network info cache for port d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Start _get_guest_xml network_info=[{"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:57:10 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:10 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1792224443',display_name='tempest-AttachVolumeTestJSON-server-1792224443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1792224443',id=24,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwTHCRRw1KxJLD9CcCs2gIwosvX+o4FaLgfSFYOuEANvq2aIipEcsGq1NHxa+NHKqWzzuxELOvKadsYZSKZeiQ7BOeCDXZ3VUvf4hvZmX1n4PdafIxgOfEgrSs9aoeq3Q==',key_name='tempest-keypair-1778122280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-iw0i0sws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:57:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=75295499-8f99-4c9b-a556-c1287c61d8f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.objects.instance [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'pci_devices' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:57:10 user nova-compute[76161]:   <uuid>75295499-8f99-4c9b-a556-c1287c61d8f2</uuid>
Nov 14 17:57:10 user nova-compute[76161]:   <name>instance-00000018</name>
Nov 14 17:57:10 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:57:10 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:57:10 user nova-compute[76161]:   <metadata>
Nov 14 17:57:10 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:57:10 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:57:10 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeTestJSON-server-1792224443</nova:name>
Nov 14 17:57:10 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:57:10</nova:creationTime>
Nov 14 17:57:10 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:57:10 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:57:10 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:57:10 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:57:10 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:57:10 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:57:10 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:57:10 user nova-compute[76161]:       <nova:owner>
Nov 14 17:57:10 user nova-compute[76161]:         <nova:user uuid="89b7172f3aea4ef29587ca01c39be2f6">tempest-AttachVolumeTestJSON-1978358229-project-member</nova:user>
Nov 14 17:57:10 user nova-compute[76161]:         <nova:project uuid="0413439dcb2e49d496bf267c63163178">tempest-AttachVolumeTestJSON-1978358229</nova:project>
Nov 14 17:57:10 user nova-compute[76161]:       </nova:owner>
Nov 14 17:57:10 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:57:10 user nova-compute[76161]:       <nova:ports>
Nov 14 17:57:10 user nova-compute[76161]:         <nova:port uuid="d9c3c5f8-f77b-4475-9693-c63f6e310d19">
Nov 14 17:57:10 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 17:57:10 user nova-compute[76161]:         </nova:port>
Nov 14 17:57:10 user nova-compute[76161]:       </nova:ports>
Nov 14 17:57:10 user nova-compute[76161]:     </nova:instance>
Nov 14 17:57:10 user nova-compute[76161]:   </metadata>
Nov 14 17:57:10 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:57:10 user nova-compute[76161]:     <system>
Nov 14 17:57:10 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:57:10 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:57:10 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:57:10 user nova-compute[76161]:       <entry name="serial">75295499-8f99-4c9b-a556-c1287c61d8f2</entry>
Nov 14 17:57:10 user nova-compute[76161]:       <entry name="uuid">75295499-8f99-4c9b-a556-c1287c61d8f2</entry>
Nov 14 17:57:10 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:57:10 user nova-compute[76161]:     </system>
Nov 14 17:57:10 user nova-compute[76161]:   </sysinfo>
Nov 14 17:57:10 user nova-compute[76161]:   <os>
Nov 14 17:57:10 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:57:10 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:57:10 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:57:10 user nova-compute[76161]:   </os>
Nov 14 17:57:10 user nova-compute[76161]:   <features>
Nov 14 17:57:10 user nova-compute[76161]:     <acpi/>
Nov 14 17:57:10 user nova-compute[76161]:     <apic/>
Nov 14 17:57:10 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:57:10 user nova-compute[76161]:   </features>
Nov 14 17:57:10 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:57:10 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:57:10 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:57:10 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:57:10 user nova-compute[76161]:   </clock>
Nov 14 17:57:10 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:57:10 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:57:10 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:57:10 user nova-compute[76161]:   </cpu>
Nov 14 17:57:10 user nova-compute[76161]:   <devices>
Nov 14 17:57:10 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:57:10 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:57:10 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk"/>
Nov 14 17:57:10 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:57:10 user nova-compute[76161]:     </disk>
Nov 14 17:57:10 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:57:10 user nova-compute[76161]:       <mac address="fa:16:3e:38:ed:cd"/>
Nov 14 17:57:10 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:57:10 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:57:10 user nova-compute[76161]:       <target dev="tapd9c3c5f8-f7"/>
Nov 14 17:57:10 user nova-compute[76161]:     </interface>
Nov 14 17:57:10 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:57:10 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/console.log" append="off"/>
Nov 14 17:57:10 user nova-compute[76161]:     </serial>
Nov 14 17:57:10 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:57:10 user nova-compute[76161]:     <video>
Nov 14 17:57:10 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:57:10 user nova-compute[76161]:     </video>
Nov 14 17:57:10 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:57:10 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:57:10 user nova-compute[76161]:     </rng>
Nov 14 17:57:10 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:57:10 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:57:10 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:57:10 user nova-compute[76161]:     </memballoon>
Nov 14 17:57:10 user nova-compute[76161]:   </devices>
Nov 14 17:57:10 user nova-compute[76161]: </domain>
Nov 14 17:57:10 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1792224443',display_name='tempest-AttachVolumeTestJSON-server-1792224443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1792224443',id=24,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwTHCRRw1KxJLD9CcCs2gIwosvX+o4FaLgfSFYOuEANvq2aIipEcsGq1NHxa+NHKqWzzuxELOvKadsYZSKZeiQ7BOeCDXZ3VUvf4hvZmX1n4PdafIxgOfEgrSs9aoeq3Q==',key_name='tempest-keypair-1778122280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-iw0i0sws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:57:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=75295499-8f99-4c9b-a556-c1287c61d8f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG os_vif [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f60c8db-9b1f-594b-bb34-d3400478db28', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9c3c5f8-f7, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9c3c5f8-f7, col_values=(('qos', UUID('b0416e2d-e690-420f-8276-e09864b34cde')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9c3c5f8-f7, col_values=(('external_ids', {'iface-id': 'd9c3c5f8-f77b-4475-9693-c63f6e310d19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ed:cd', 'vm-uuid': '75295499-8f99-4c9b-a556-c1287c61d8f2'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:10 user nova-compute[76161]: INFO os_vif [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7')
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No VIF found with MAC fa:16:3e:38:ed:cd, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.network.neutron [req-fd5f8d9c-ea6b-4735-b49f-3c6452dc7a98 req-40b05bfa-6259-4028-bd83-e7439354fd01 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updated VIF entry in instance network info cache for port d9c3c5f8-f77b-4475-9693-c63f6e310d19. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG nova.network.neutron [req-fd5f8d9c-ea6b-4735-b49f-3c6452dc7a98 req-40b05bfa-6259-4028-bd83-e7439354fd01 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updating instance_info_cache with network_info: [{"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fd5f8d9c-ea6b-4735-b49f-3c6452dc7a98 req-40b05bfa-6259-4028-bd83-e7439354fd01 service nova] Releasing lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-fd2f99a8-b6d4-468c-8bc5-e5b9a98c2862 req-0280d3cf-8e12-4e86-a7ec-49e5a5dbb092 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fd2f99a8-b6d4-468c-8bc5-e5b9a98c2862 req-0280d3cf-8e12-4e86-a7ec-49e5a5dbb092 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fd2f99a8-b6d4-468c-8bc5-e5b9a98c2862 req-0280d3cf-8e12-4e86-a7ec-49e5a5dbb092 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fd2f99a8-b6d4-468c-8bc5-e5b9a98c2862 req-0280d3cf-8e12-4e86-a7ec-49e5a5dbb092 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-fd2f99a8-b6d4-468c-8bc5-e5b9a98c2862 req-0280d3cf-8e12-4e86-a7ec-49e5a5dbb092 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:11 user nova-compute[76161]: WARNING nova.compute.manager [req-fd2f99a8-b6d4-468c-8bc5-e5b9a98c2862 req-0280d3cf-8e12-4e86-a7ec-49e5a5dbb092 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state building and task_state spawning.
Nov 14 17:57:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-cda54141-1cfd-470f-b3e7-c2d1c1e32cb3 req-89f8b7f1-dff9-44a2-a34c-e2fdff760dd9 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cda54141-1cfd-470f-b3e7-c2d1c1e32cb3 req-89f8b7f1-dff9-44a2-a34c-e2fdff760dd9 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cda54141-1cfd-470f-b3e7-c2d1c1e32cb3 req-89f8b7f1-dff9-44a2-a34c-e2fdff760dd9 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cda54141-1cfd-470f-b3e7-c2d1c1e32cb3 req-89f8b7f1-dff9-44a2-a34c-e2fdff760dd9 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-cda54141-1cfd-470f-b3e7-c2d1c1e32cb3 req-89f8b7f1-dff9-44a2-a34c-e2fdff760dd9 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:14 user nova-compute[76161]: WARNING nova.compute.manager [req-cda54141-1cfd-470f-b3e7-c2d1c1e32cb3 req-89f8b7f1-dff9-44a2-a34c-e2fdff760dd9 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state building and task_state spawning.
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:57:14 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance spawned successfully.
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:14 user nova-compute[76161]: INFO nova.compute.manager [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 14 17:57:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:57:14 user nova-compute[76161]: INFO nova.compute.manager [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Took 7.22 seconds to build instance.
Nov 14 17:57:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ecd8de8b-6fd1-48fb-8f36-8afe6b409686 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.316s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:15 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:57:15 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:57:15 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:57:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:57:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:15 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:57:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Updating instance_info_cache with network_info: [{"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:57:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:57:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:57:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:57:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:57:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:57:16 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:57:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:57:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-6deccb2b-03c7-474e-b8ab-3cb9ca211f33 req-589cdadf-a33c-435a-8c9f-38b6d1e4b657 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Received event network-changed-ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-6deccb2b-03c7-474e-b8ab-3cb9ca211f33 req-589cdadf-a33c-435a-8c9f-38b6d1e4b657 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Refreshing instance network info cache due to event network-changed-ebc07478-edbf-4287-a29e-3015527a60d4. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6deccb2b-03c7-474e-b8ab-3cb9ca211f33 req-589cdadf-a33c-435a-8c9f-38b6d1e4b657 service nova] Acquiring lock "refresh_cache-7eeac8f5-64d4-4da0-817f-376603bb54a1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6deccb2b-03c7-474e-b8ab-3cb9ca211f33 req-589cdadf-a33c-435a-8c9f-38b6d1e4b657 service nova] Acquired lock "refresh_cache-7eeac8f5-64d4-4da0-817f-376603bb54a1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG nova.network.neutron [req-6deccb2b-03c7-474e-b8ab-3cb9ca211f33 req-589cdadf-a33c-435a-8c9f-38b6d1e4b657 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Refreshing network info cache for port ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "7eeac8f5-64d4-4da0-817f-376603bb54a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "7eeac8f5-64d4-4da0-817f-376603bb54a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:19 user nova-compute[76161]: INFO nova.compute.manager [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Terminating instance
Nov 14 17:57:19 user nova-compute[76161]: DEBUG nova.compute.manager [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG nova.network.neutron [req-6deccb2b-03c7-474e-b8ab-3cb9ca211f33 req-589cdadf-a33c-435a-8c9f-38b6d1e4b657 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Updated VIF entry in instance network info cache for port ebc07478-edbf-4287-a29e-3015527a60d4. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG nova.network.neutron [req-6deccb2b-03c7-474e-b8ab-3cb9ca211f33 req-589cdadf-a33c-435a-8c9f-38b6d1e4b657 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Updating instance_info_cache with network_info: [{"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6deccb2b-03c7-474e-b8ab-3cb9ca211f33 req-589cdadf-a33c-435a-8c9f-38b6d1e4b657 service nova] Releasing lock "refresh_cache-7eeac8f5-64d4-4da0-817f-376603bb54a1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:19 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Instance destroyed successfully.
Nov 14 17:57:19 user nova-compute[76161]: DEBUG nova.objects.instance [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'resources' on Instance uuid 7eeac8f5-64d4-4da0-817f-376603bb54a1 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2072328386',display_name='tempest-AttachVolumeNegativeTest-server-2072328386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2072328386',id=23,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOQkGev2TJ17CRibkPstuAcMPOYnPfFCUvyoujm4MSbNLXERF5WPBDZ3b/daiBa4Pts/XBKlj7qOS6BFPrlzrgmHEr4T88me7ynDNQcMRsdSGkRnPZPac1DKLMixy190A==',key_name='tempest-keypair-1019750047',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-jsc1uhg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:55:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=7eeac8f5-64d4-4da0-817f-376603bb54a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "ebc07478-edbf-4287-a29e-3015527a60d4", "address": "fa:16:3e:ca:e4:83", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc07478-ed", "ovs_interfaceid": "ebc07478-edbf-4287-a29e-3015527a60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e4:83,bridge_name='br-int',has_traffic_filtering=True,id=ebc07478-edbf-4287-a29e-3015527a60d4,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc07478-ed') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG os_vif [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e4:83,bridge_name='br-int',has_traffic_filtering=True,id=ebc07478-edbf-4287-a29e-3015527a60d4,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc07478-ed') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebc07478-ed, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6911f985-14b9-4eb4-9a57-1794be0aaa41) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:19 user nova-compute[76161]: INFO os_vif [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e4:83,bridge_name='br-int',has_traffic_filtering=True,id=ebc07478-edbf-4287-a29e-3015527a60d4,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc07478-ed')
Nov 14 17:57:19 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Deleting instance files /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1_del
Nov 14 17:57:19 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Deletion of /opt/stack/data/nova/instances/7eeac8f5-64d4-4da0-817f-376603bb54a1_del complete
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:19 user nova-compute[76161]: INFO nova.compute.manager [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Took 0.81 seconds to destroy the instance on the hypervisor.
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:20 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b is timed out.
Nov 14 17:57:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Successfully detached device vdb from instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b from the live domain config.
Nov 14 17:57:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StesAolq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:57:20 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6694a3e-bc3c-413c-9bd6-0250254c1d70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:57:20 user nova-compute[76161]: No targets found.
Nov 14 17:57:20 user nova-compute[76161]: iSNS:
Nov 14 17:57:20 user nova-compute[76161]: No targets found.
Nov 14 17:57:20 user nova-compute[76161]: STATIC:
Nov 14 17:57:20 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8
Nov 14 17:57:20 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:57:20 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:57:20 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140
Nov 14 17:57:20 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:57:20 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:57:20 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:57:20 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:57:20 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:57:20 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:57:20 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:57:20 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:57:20 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:57:20 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:57:20 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:57:20 user nova-compute[76161]: FIRMWARE:
Nov 14 17:57:20 user nova-compute[76161]: No targets found.
Nov 14 17:57:20 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:57:20 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:57:20 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d6c821-1d0d-4b7b-a844-673785b854f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d30f1b4-d1e3-421c-af40-c84fe09e132d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:57:20 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:57:20 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:57:20 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:57:20 user nova-compute[76161]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 (non-flash)
Nov 14 17:57:20 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:57:20 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:57:20 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:57:20 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:57:20 user nova-compute[76161]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 (non-flash)
Nov 14 17:57:20 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f8191750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140'): ({'sdf'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Removing single pathed devices sdf {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6394d4-5afe-4af4-80b6-79f99eb9f0b0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7ab8e9-06b0-4751-9177-300f4026d6b9]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Flushing IO for device /dev/sdf {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2e54b1-f5de-4997-91cb-1fe01d4388c1]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d949ff0b-879a-49c8-8f79-249c74998d3f]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45a939e-68a8-411d-abc6-c7f97442e1b4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0705463d-3f14-4e18-807a-d2bd9dcda0b3]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140, portal: 172.16.0.220,3260]
Nov 14 17:57:20 user nova-compute[76161]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140, portal: 172.16.0.220,3260] successful.
Nov 14 17:57:20 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:258b3fe8-bc78-4441-bdd3-76b2a87b4140 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bdbbb1-619d-4a7d-9e69-a02114bc4662]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] <== disconnect_volume: return (436ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:20 user nova-compute[76161]: INFO nova.compute.manager [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Terminating instance
Nov 14 17:57:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:21 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Took 1.18 seconds to deallocate network for instance.
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-5467af31-a538-4f1d-9ae5-8e5abf6c4681 req-8ac4ce13-0832-49b9-b151-b3ad991aa245 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Received event network-vif-deleted-ebc07478-edbf-4287-a29e-3015527a60d4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:21 user nova-compute[76161]: INFO nova.compute.manager [req-5467af31-a538-4f1d-9ae5-8e5abf6c4681 req-8ac4ce13-0832-49b9-b151-b3ad991aa245 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Neutron deleted interface ebc07478-edbf-4287-a29e-3015527a60d4; detaching it from the instance and deleting it from the info cache
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.network.neutron [req-5467af31-a538-4f1d-9ae5-8e5abf6c4681 req-8ac4ce13-0832-49b9-b151-b3ad991aa245 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-5467af31-a538-4f1d-9ae5-8e5abf6c4681 req-8ac4ce13-0832-49b9-b151-b3ad991aa245 service nova] [instance: 7eeac8f5-64d4-4da0-817f-376603bb54a1] Detach interface failed, port_id=ebc07478-edbf-4287-a29e-3015527a60d4, reason: Instance 7eeac8f5-64d4-4da0-817f-376603bb54a1 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.objects.instance [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lazy-loading 'flavor' on Instance uuid 6e87b617-e12f-4c33-bd5d-8f1bc07c417b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ee9e3233-e0fe-486d-8633-8c85f1974abf tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.088s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:57:21 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Instance destroyed successfully.
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.objects.instance [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lazy-loading 'resources' on Instance uuid fdcdc21a-3601-4f26-8da3-f345c35d839d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1407322857',display_name='tempest-TestVolumeSwap-server-1407322857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1407322857',id=21,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4YOBCjMVd+vpJJHziZCKYEq7lKymcYS1ILvo9TvK0nCx3LnHRLd6ZqrFetTGl2Eouc0TqPNswi2gOehvE2va54Ec0AkFIYSyTN0nHeaT1EBH3czAjUrKXihAd4anWIA==',key_name='tempest-keypair-1162978824',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:54:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6afde13e69f4185b045ae4f93063363',ramdisk_id='',reservation_id='r-quf60n98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2114207770',owner_user_name='tempest-TestVolumeSwap-2114207770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:54:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d894650d77b475e9894d1e55cf3a153',uuid=fdcdc21a-3601-4f26-8da3-f345c35d839d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Converting VIF {"id": "6c769206-c0b4-4709-bea6-76a2cc640a57", "address": "fa:16:3e:ef:c5:37", "network": {"id": "808f1145-de86-4e68-b23a-ab33ba6cf807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-437971817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6afde13e69f4185b045ae4f93063363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c769206-c0", "ovs_interfaceid": "6c769206-c0b4-4709-bea6-76a2cc640a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=6c769206-c0b4-4709-bea6-76a2cc640a57,network=Network(808f1145-de86-4e68-b23a-ab33ba6cf807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c769206-c0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG os_vif [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=6c769206-c0b4-4709-bea6-76a2cc640a57,network=Network(808f1145-de86-4e68-b23a-ab33ba6cf807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c769206-c0') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.677s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c769206-c0, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ee8e375-45c1-4031-acae-36da8ce2da45) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:21 user nova-compute[76161]: INFO os_vif [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=6c769206-c0b4-4709-bea6-76a2cc640a57,network=Network(808f1145-de86-4e68-b23a-ab33ba6cf807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c769206-c0')
Nov 14 17:57:21 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Deleting instance files /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d_del
Nov 14 17:57:21 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Deletion of /opt/stack/data/nova/instances/fdcdc21a-3601-4f26-8da3-f345c35d839d_del complete
Nov 14 17:57:21 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Deleted allocations for instance 7eeac8f5-64d4-4da0-817f-376603bb54a1
Nov 14 17:57:21 user nova-compute[76161]: INFO nova.compute.manager [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-143ae184-2e01-4307-af99-b525b05226f4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "7eeac8f5-64d4-4da0-817f-376603bb54a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.989s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:22 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '7eeac8f5-64d4-4da0-817f-376603bb54a1' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '7eeac8f5-64d4-4da0-817f-376603bb54a1' (instance-00000017)
Nov 14 17:57:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:57:23 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:23 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=25.28719711303711GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received event network-vif-unplugged-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] No waiting events found dispatching network-vif-unplugged-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received event network-vif-unplugged-6c769206-c0b4-4709-bea6-76a2cc640a57 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received event network-vif-plugged-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] Acquiring lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] No waiting events found dispatching network-vif-plugged-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:23 user nova-compute[76161]: WARNING nova.compute.manager [req-bf6370a7-1030-4a1a-a951-5b46b0c5c85a req-ff90e367-4d5e-4f2a-a09a-e5432a4511f9 service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received unexpected event network-vif-plugged-6c769206-c0b4-4709-bea6-76a2cc640a57 for instance with vm_state active and task_state deleting.
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56848a92-97b3-4eef-b924-de8ab85ad115 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56f47238-81fe-4196-865c-e1ad68cf6fea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 76193048-410d-4a59-9eb5-165d8ce0af6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance fdcdc21a-3601-4f26-8da3-f345c35d839d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 75295499-8f99-4c9b-a556-c1287c61d8f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:23 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Took 1.45 seconds to deallocate network for instance.
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.164s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:57:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:24 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Deleted allocations for instance fdcdc21a-3601-4f26-8da3-f345c35d839d
Nov 14 17:57:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-90d728f3-3467-42f1-95c0-c2038a57827f tempest-TestVolumeSwap-2114207770 tempest-TestVolumeSwap-2114207770-project-member] Lock "fdcdc21a-3601-4f26-8da3-f345c35d839d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.217s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:57:24 user nova-compute[76161]: INFO nova.compute.claims [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Claim successful on node user
Nov 14 17:57:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:57:24 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:57:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:57:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG nova.policy [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '697caec857bd4d6089435bcc9016e3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1687dfa28b6143d5a39d894cb3d943f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:57:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Creating image(s)
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "/opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "/opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-11786062-1e23-491b-8ef1-7d8bee397db9 req-29a1a9a5-0364-4f0e-b58c-5cb3480d800f service nova] [instance: fdcdc21a-3601-4f26-8da3-f345c35d839d] Received event network-vif-deleted-6c769206-c0b4-4709-bea6-76a2cc640a57 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.207s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk 1073741824" returned: 0 in 0.061s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.211s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:57:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:26 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Cannot resize image /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:57:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:57:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Ensure instance console log exists: /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:57:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Successfully created port: ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:57:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Successfully updated port: ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:57:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "refresh_cache-8a5c3b81-d4e1-416f-9512-592fe67cae44" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquired lock "refresh_cache-8a5c3b81-d4e1-416f-9512-592fe67cae44" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:57:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-cc52bbd9-24c6-45da-afb6-6e05ec5ff120 req-7aba5e9f-1aea-4c52-b09f-83b24e6c3c12 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received event network-changed-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-cc52bbd9-24c6-45da-afb6-6e05ec5ff120 req-7aba5e9f-1aea-4c52-b09f-83b24e6c3c12 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Refreshing instance network info cache due to event network-changed-ec00dfa7-65ad-414a-9001-06902e33b728. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:57:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cc52bbd9-24c6-45da-afb6-6e05ec5ff120 req-7aba5e9f-1aea-4c52-b09f-83b24e6c3c12 service nova] Acquiring lock "refresh_cache-8a5c3b81-d4e1-416f-9512-592fe67cae44" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Updating instance_info_cache with network_info: [{"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Releasing lock "refresh_cache-8a5c3b81-d4e1-416f-9512-592fe67cae44" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Instance network_info: |[{"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cc52bbd9-24c6-45da-afb6-6e05ec5ff120 req-7aba5e9f-1aea-4c52-b09f-83b24e6c3c12 service nova] Acquired lock "refresh_cache-8a5c3b81-d4e1-416f-9512-592fe67cae44" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.network.neutron [req-cc52bbd9-24c6-45da-afb6-6e05ec5ff120 req-7aba5e9f-1aea-4c52-b09f-83b24e6c3c12 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Refreshing network info cache for port ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Start _get_guest_xml network_info=[{"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:57:29 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:29 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-189553259',display_name='tempest-SnapshotDataIntegrityTests-server-189553259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-189553259',id=25,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDt3lo6Y8Z81wxoX7amNiseedBPKYvwo1v10BHhBgMUDV0Hl64h0dxZPjY9qdMXj+xl098UBo67rxy12yJUJzYOR7oNSRwlKN7vehX8KF5qd4cKBS+67e6abaQcZpZKszg==',key_name='tempest-keypair-852008085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1687dfa28b6143d5a39d894cb3d943f9',ramdisk_id='',reservation_id='r-17qclt8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-21028194',owner_user_name='tempest-SnapshotDataIntegrityTests-21028194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:57:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='697caec857bd4d6089435bcc9016e3b2',uuid=8a5c3b81-d4e1-416f-9512-592fe67cae44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Converting VIF {"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:51:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec00dfa7-65ad-414a-9001-06902e33b728,network=Network(83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec00dfa7-65') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:57:29 user nova-compute[76161]:   <uuid>8a5c3b81-d4e1-416f-9512-592fe67cae44</uuid>
Nov 14 17:57:29 user nova-compute[76161]:   <name>instance-00000019</name>
Nov 14 17:57:29 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:57:29 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:57:29 user nova-compute[76161]:   <metadata>
Nov 14 17:57:29 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:57:29 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:57:29 user nova-compute[76161]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-189553259</nova:name>
Nov 14 17:57:29 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:57:29</nova:creationTime>
Nov 14 17:57:29 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:57:29 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:57:29 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:57:29 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:57:29 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:57:29 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:57:29 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:57:29 user nova-compute[76161]:       <nova:owner>
Nov 14 17:57:29 user nova-compute[76161]:         <nova:user uuid="697caec857bd4d6089435bcc9016e3b2">tempest-SnapshotDataIntegrityTests-21028194-project-member</nova:user>
Nov 14 17:57:29 user nova-compute[76161]:         <nova:project uuid="1687dfa28b6143d5a39d894cb3d943f9">tempest-SnapshotDataIntegrityTests-21028194</nova:project>
Nov 14 17:57:29 user nova-compute[76161]:       </nova:owner>
Nov 14 17:57:29 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:57:29 user nova-compute[76161]:       <nova:ports>
Nov 14 17:57:29 user nova-compute[76161]:         <nova:port uuid="ec00dfa7-65ad-414a-9001-06902e33b728">
Nov 14 17:57:29 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 17:57:29 user nova-compute[76161]:         </nova:port>
Nov 14 17:57:29 user nova-compute[76161]:       </nova:ports>
Nov 14 17:57:29 user nova-compute[76161]:     </nova:instance>
Nov 14 17:57:29 user nova-compute[76161]:   </metadata>
Nov 14 17:57:29 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:57:29 user nova-compute[76161]:     <system>
Nov 14 17:57:29 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:57:29 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:57:29 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:57:29 user nova-compute[76161]:       <entry name="serial">8a5c3b81-d4e1-416f-9512-592fe67cae44</entry>
Nov 14 17:57:29 user nova-compute[76161]:       <entry name="uuid">8a5c3b81-d4e1-416f-9512-592fe67cae44</entry>
Nov 14 17:57:29 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:57:29 user nova-compute[76161]:     </system>
Nov 14 17:57:29 user nova-compute[76161]:   </sysinfo>
Nov 14 17:57:29 user nova-compute[76161]:   <os>
Nov 14 17:57:29 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:57:29 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:57:29 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:57:29 user nova-compute[76161]:   </os>
Nov 14 17:57:29 user nova-compute[76161]:   <features>
Nov 14 17:57:29 user nova-compute[76161]:     <acpi/>
Nov 14 17:57:29 user nova-compute[76161]:     <apic/>
Nov 14 17:57:29 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:57:29 user nova-compute[76161]:   </features>
Nov 14 17:57:29 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:57:29 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:57:29 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:57:29 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:57:29 user nova-compute[76161]:   </clock>
Nov 14 17:57:29 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:57:29 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:57:29 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:57:29 user nova-compute[76161]:   </cpu>
Nov 14 17:57:29 user nova-compute[76161]:   <devices>
Nov 14 17:57:29 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:57:29 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:57:29 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk"/>
Nov 14 17:57:29 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:57:29 user nova-compute[76161]:     </disk>
Nov 14 17:57:29 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:57:29 user nova-compute[76161]:       <mac address="fa:16:3e:24:51:b7"/>
Nov 14 17:57:29 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:57:29 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:57:29 user nova-compute[76161]:       <target dev="tapec00dfa7-65"/>
Nov 14 17:57:29 user nova-compute[76161]:     </interface>
Nov 14 17:57:29 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:57:29 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/console.log" append="off"/>
Nov 14 17:57:29 user nova-compute[76161]:     </serial>
Nov 14 17:57:29 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:57:29 user nova-compute[76161]:     <video>
Nov 14 17:57:29 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:57:29 user nova-compute[76161]:     </video>
Nov 14 17:57:29 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:57:29 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:57:29 user nova-compute[76161]:     </rng>
Nov 14 17:57:29 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:57:29 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:57:29 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:57:29 user nova-compute[76161]:     </memballoon>
Nov 14 17:57:29 user nova-compute[76161]:   </devices>
Nov 14 17:57:29 user nova-compute[76161]: </domain>
Nov 14 17:57:29 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-189553259',display_name='tempest-SnapshotDataIntegrityTests-server-189553259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-189553259',id=25,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDt3lo6Y8Z81wxoX7amNiseedBPKYvwo1v10BHhBgMUDV0Hl64h0dxZPjY9qdMXj+xl098UBo67rxy12yJUJzYOR7oNSRwlKN7vehX8KF5qd4cKBS+67e6abaQcZpZKszg==',key_name='tempest-keypair-852008085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1687dfa28b6143d5a39d894cb3d943f9',ramdisk_id='',reservation_id='r-17qclt8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-21028194',owner_user_name='tempest-SnapshotDataIntegrityTests-21028194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:57:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='697caec857bd4d6089435bcc9016e3b2',uuid=8a5c3b81-d4e1-416f-9512-592fe67cae44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Converting VIF {"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:51:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec00dfa7-65ad-414a-9001-06902e33b728,network=Network(83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec00dfa7-65') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG os_vif [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:51:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec00dfa7-65ad-414a-9001-06902e33b728,network=Network(83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec00dfa7-65') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2632c914-2b11-50b2-b2a8-1cf82a9bd9b4', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec00dfa7-65, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec00dfa7-65, col_values=(('qos', UUID('23588056-3de9-4783-8a55-8665206cdd49')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec00dfa7-65, col_values=(('external_ids', {'iface-id': 'ec00dfa7-65ad-414a-9001-06902e33b728', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:51:b7', 'vm-uuid': '8a5c3b81-d4e1-416f-9512-592fe67cae44'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:29 user nova-compute[76161]: INFO os_vif [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:51:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec00dfa7-65ad-414a-9001-06902e33b728,network=Network(83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec00dfa7-65')
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:57:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No VIF found with MAC fa:16:3e:24:51:b7, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:57:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:30 user nova-compute[76161]: DEBUG nova.network.neutron [req-cc52bbd9-24c6-45da-afb6-6e05ec5ff120 req-7aba5e9f-1aea-4c52-b09f-83b24e6c3c12 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Updated VIF entry in instance network info cache for port ec00dfa7-65ad-414a-9001-06902e33b728. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:57:30 user nova-compute[76161]: DEBUG nova.network.neutron [req-cc52bbd9-24c6-45da-afb6-6e05ec5ff120 req-7aba5e9f-1aea-4c52-b09f-83b24e6c3c12 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Updating instance_info_cache with network_info: [{"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cc52bbd9-24c6-45da-afb6-6e05ec5ff120 req-7aba5e9f-1aea-4c52-b09f-83b24e6c3c12 service nova] Releasing lock "refresh_cache-8a5c3b81-d4e1-416f-9512-592fe67cae44" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-8a3feb63-a104-4ae7-b31e-b4ca3496481f req-ee30007b-8385-4711-898d-c842af83182a service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received event network-vif-plugged-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8a3feb63-a104-4ae7-b31e-b4ca3496481f req-ee30007b-8385-4711-898d-c842af83182a service nova] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8a3feb63-a104-4ae7-b31e-b4ca3496481f req-ee30007b-8385-4711-898d-c842af83182a service nova] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8a3feb63-a104-4ae7-b31e-b4ca3496481f req-ee30007b-8385-4711-898d-c842af83182a service nova] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-8a3feb63-a104-4ae7-b31e-b4ca3496481f req-ee30007b-8385-4711-898d-c842af83182a service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] No waiting events found dispatching network-vif-plugged-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:33 user nova-compute[76161]: WARNING nova.compute.manager [req-8a3feb63-a104-4ae7-b31e-b4ca3496481f req-ee30007b-8385-4711-898d-c842af83182a service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received unexpected event network-vif-plugged-ec00dfa7-65ad-414a-9001-06902e33b728 for instance with vm_state building and task_state spawning.
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:57:33 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Instance spawned successfully.
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:33 user nova-compute[76161]: INFO nova.compute.manager [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Took 8.25 seconds to spawn the instance on the hypervisor.
Nov 14 17:57:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:57:33 user nova-compute[76161]: INFO nova.compute.manager [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Took 9.40 seconds to build instance.
Nov 14 17:57:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6e9cfed6-cf49-47fb-aaff-85fa7601ca71 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.540s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-77339773-362e-40ec-83bc-527f82a96eff req-2c5f8490-94f6-420d-86eb-026be4d44dc6 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received event network-vif-plugged-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-77339773-362e-40ec-83bc-527f82a96eff req-2c5f8490-94f6-420d-86eb-026be4d44dc6 service nova] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-77339773-362e-40ec-83bc-527f82a96eff req-2c5f8490-94f6-420d-86eb-026be4d44dc6 service nova] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-77339773-362e-40ec-83bc-527f82a96eff req-2c5f8490-94f6-420d-86eb-026be4d44dc6 service nova] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-77339773-362e-40ec-83bc-527f82a96eff req-2c5f8490-94f6-420d-86eb-026be4d44dc6 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] No waiting events found dispatching network-vif-plugged-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:35 user nova-compute[76161]: WARNING nova.compute.manager [req-77339773-362e-40ec-83bc-527f82a96eff req-2c5f8490-94f6-420d-86eb-026be4d44dc6 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received unexpected event network-vif-plugged-ec00dfa7-65ad-414a-9001-06902e33b728 for instance with vm_state active and task_state None.
Nov 14 17:57:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:57:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:57:38 user nova-compute[76161]: INFO nova.compute.claims [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Claim successful on node user
Nov 14 17:57:39 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG nova.compute.manager [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG nova.compute.manager [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG nova.network.neutron [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:57:39 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:57:39 user nova-compute[76161]: DEBUG nova.compute.manager [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG nova.policy [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57d10aae86db4e6cac70ba82a4de78c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1742bececec94ff8bbd69773788c05e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG nova.compute.manager [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:57:39 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Creating image(s)
Nov 14 17:57:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "/opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "/opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "/opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.204s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk 1073741824" returned: 0 in 0.054s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Successfully created port: acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Cannot resize image /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Ensure instance console log exists: /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Successfully updated port: acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "refresh_cache-952593b7-cc8b-4d50-8aa8-a50e385e088b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquired lock "refresh_cache-952593b7-cc8b-4d50-8aa8-a50e385e088b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-9e5eda8d-5863-4751-a667-1784ad3ef340 req-d5586b11-3972-4396-9364-15ecfc27de0e service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received event network-changed-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-9e5eda8d-5863-4751-a667-1784ad3ef340 req-d5586b11-3972-4396-9364-15ecfc27de0e service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Refreshing instance network info cache due to event network-changed-acaa3207-c1d5-4d0a-ad74-de7cb45ab810. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9e5eda8d-5863-4751-a667-1784ad3ef340 req-d5586b11-3972-4396-9364-15ecfc27de0e service nova] Acquiring lock "refresh_cache-952593b7-cc8b-4d50-8aa8-a50e385e088b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.network.neutron [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Updating instance_info_cache with network_info: [{"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Releasing lock "refresh_cache-952593b7-cc8b-4d50-8aa8-a50e385e088b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.compute.manager [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Instance network_info: |[{"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9e5eda8d-5863-4751-a667-1784ad3ef340 req-d5586b11-3972-4396-9364-15ecfc27de0e service nova] Acquired lock "refresh_cache-952593b7-cc8b-4d50-8aa8-a50e385e088b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.network.neutron [req-9e5eda8d-5863-4751-a667-1784ad3ef340 req-d5586b11-3972-4396-9364-15ecfc27de0e service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Refreshing network info cache for port acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Start _get_guest_xml network_info=[{"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:57:41 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:41 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1882407709',display_name='tempest-TestServerVolumeAttachmentScenario-server-1882407709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1882407709',id=26,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+4/DN5Ily1A4h0678494WRM3uSqapZDyhe6rp4gOPRCchQjvBHHNRxmViH0sFPYNwi3iVTbF0beE9Z73Dl3YtwY1kRwOKPlAAOM8gZbRhoI3ZndnUytL0SBlFF/gdIQg==',key_name='tempest-keypair-584016234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1742bececec94ff8bbd69773788c05e9',ramdisk_id='',reservation_id='r-a8ok6d9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1591584694',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1591584694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d10aae86db4e6cac70ba82a4de78c5',uuid=952593b7-cc8b-4d50-8aa8-a50e385e088b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Converting VIF {"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:91:d7,bridge_name='br-int',has_traffic_filtering=True,id=acaa3207-c1d5-4d0a-ad74-de7cb45ab810,network=Network(0b0526d0-1417-4be5-84ed-3e77cf62c36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaa3207-c1') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.objects.instance [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lazy-loading 'pci_devices' on Instance uuid 952593b7-cc8b-4d50-8aa8-a50e385e088b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:57:41 user nova-compute[76161]:   <uuid>952593b7-cc8b-4d50-8aa8-a50e385e088b</uuid>
Nov 14 17:57:41 user nova-compute[76161]:   <name>instance-0000001a</name>
Nov 14 17:57:41 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:57:41 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:57:41 user nova-compute[76161]:   <metadata>
Nov 14 17:57:41 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:57:41 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:57:41 user nova-compute[76161]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1882407709</nova:name>
Nov 14 17:57:41 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:57:41</nova:creationTime>
Nov 14 17:57:41 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:57:41 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:57:41 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:57:41 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:57:41 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:57:41 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:57:41 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:57:41 user nova-compute[76161]:       <nova:owner>
Nov 14 17:57:41 user nova-compute[76161]:         <nova:user uuid="57d10aae86db4e6cac70ba82a4de78c5">tempest-TestServerVolumeAttachmentScenario-1591584694-project-member</nova:user>
Nov 14 17:57:41 user nova-compute[76161]:         <nova:project uuid="1742bececec94ff8bbd69773788c05e9">tempest-TestServerVolumeAttachmentScenario-1591584694</nova:project>
Nov 14 17:57:41 user nova-compute[76161]:       </nova:owner>
Nov 14 17:57:41 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:57:41 user nova-compute[76161]:       <nova:ports>
Nov 14 17:57:41 user nova-compute[76161]:         <nova:port uuid="acaa3207-c1d5-4d0a-ad74-de7cb45ab810">
Nov 14 17:57:41 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 17:57:41 user nova-compute[76161]:         </nova:port>
Nov 14 17:57:41 user nova-compute[76161]:       </nova:ports>
Nov 14 17:57:41 user nova-compute[76161]:     </nova:instance>
Nov 14 17:57:41 user nova-compute[76161]:   </metadata>
Nov 14 17:57:41 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:57:41 user nova-compute[76161]:     <system>
Nov 14 17:57:41 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:57:41 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:57:41 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:57:41 user nova-compute[76161]:       <entry name="serial">952593b7-cc8b-4d50-8aa8-a50e385e088b</entry>
Nov 14 17:57:41 user nova-compute[76161]:       <entry name="uuid">952593b7-cc8b-4d50-8aa8-a50e385e088b</entry>
Nov 14 17:57:41 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:57:41 user nova-compute[76161]:     </system>
Nov 14 17:57:41 user nova-compute[76161]:   </sysinfo>
Nov 14 17:57:41 user nova-compute[76161]:   <os>
Nov 14 17:57:41 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:57:41 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:57:41 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:57:41 user nova-compute[76161]:   </os>
Nov 14 17:57:41 user nova-compute[76161]:   <features>
Nov 14 17:57:41 user nova-compute[76161]:     <acpi/>
Nov 14 17:57:41 user nova-compute[76161]:     <apic/>
Nov 14 17:57:41 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:57:41 user nova-compute[76161]:   </features>
Nov 14 17:57:41 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:57:41 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:57:41 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:57:41 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:57:41 user nova-compute[76161]:   </clock>
Nov 14 17:57:41 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:57:41 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:57:41 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:57:41 user nova-compute[76161]:   </cpu>
Nov 14 17:57:41 user nova-compute[76161]:   <devices>
Nov 14 17:57:41 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:57:41 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:57:41 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk"/>
Nov 14 17:57:41 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:57:41 user nova-compute[76161]:     </disk>
Nov 14 17:57:41 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:57:41 user nova-compute[76161]:       <mac address="fa:16:3e:29:91:d7"/>
Nov 14 17:57:41 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:57:41 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:57:41 user nova-compute[76161]:       <target dev="tapacaa3207-c1"/>
Nov 14 17:57:41 user nova-compute[76161]:     </interface>
Nov 14 17:57:41 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:57:41 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/console.log" append="off"/>
Nov 14 17:57:41 user nova-compute[76161]:     </serial>
Nov 14 17:57:41 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:57:41 user nova-compute[76161]:     <video>
Nov 14 17:57:41 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:57:41 user nova-compute[76161]:     </video>
Nov 14 17:57:41 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:57:41 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:57:41 user nova-compute[76161]:     </rng>
Nov 14 17:57:41 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:57:41 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:57:41 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:57:41 user nova-compute[76161]:     </memballoon>
Nov 14 17:57:41 user nova-compute[76161]:   </devices>
Nov 14 17:57:41 user nova-compute[76161]: </domain>
Nov 14 17:57:41 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1882407709',display_name='tempest-TestServerVolumeAttachmentScenario-server-1882407709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1882407709',id=26,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+4/DN5Ily1A4h0678494WRM3uSqapZDyhe6rp4gOPRCchQjvBHHNRxmViH0sFPYNwi3iVTbF0beE9Z73Dl3YtwY1kRwOKPlAAOM8gZbRhoI3ZndnUytL0SBlFF/gdIQg==',key_name='tempest-keypair-584016234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1742bececec94ff8bbd69773788c05e9',ramdisk_id='',reservation_id='r-a8ok6d9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1591584694',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1591584694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d10aae86db4e6cac70ba82a4de78c5',uuid=952593b7-cc8b-4d50-8aa8-a50e385e088b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Converting VIF {"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:91:d7,bridge_name='br-int',has_traffic_filtering=True,id=acaa3207-c1d5-4d0a-ad74-de7cb45ab810,network=Network(0b0526d0-1417-4be5-84ed-3e77cf62c36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaa3207-c1') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG os_vif [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:91:d7,bridge_name='br-int',has_traffic_filtering=True,id=acaa3207-c1d5-4d0a-ad74-de7cb45ab810,network=Network(0b0526d0-1417-4be5-84ed-3e77cf62c36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaa3207-c1') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b34e1845-9a76-5c41-8df0-3f44264c2ee7', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacaa3207-c1, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacaa3207-c1, col_values=(('qos', UUID('f13d2c1a-343b-4be4-b593-b5363a60f0d6')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacaa3207-c1, col_values=(('external_ids', {'iface-id': 'acaa3207-c1d5-4d0a-ad74-de7cb45ab810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:91:d7', 'vm-uuid': '952593b7-cc8b-4d50-8aa8-a50e385e088b'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:41 user nova-compute[76161]: INFO os_vif [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:91:d7,bridge_name='br-int',has_traffic_filtering=True,id=acaa3207-c1d5-4d0a-ad74-de7cb45ab810,network=Network(0b0526d0-1417-4be5-84ed-3e77cf62c36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaa3207-c1')
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] No VIF found with MAC fa:16:3e:29:91:d7, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.network.neutron [req-9e5eda8d-5863-4751-a667-1784ad3ef340 req-d5586b11-3972-4396-9364-15ecfc27de0e service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Updated VIF entry in instance network info cache for port acaa3207-c1d5-4d0a-ad74-de7cb45ab810. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG nova.network.neutron [req-9e5eda8d-5863-4751-a667-1784ad3ef340 req-d5586b11-3972-4396-9364-15ecfc27de0e service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Updating instance_info_cache with network_info: [{"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9e5eda8d-5863-4751-a667-1784ad3ef340 req-d5586b11-3972-4396-9364-15ecfc27de0e service nova] Releasing lock "refresh_cache-952593b7-cc8b-4d50-8aa8-a50e385e088b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-8920b27d-cb90-446e-8faf-fb843f088e22 req-f091616d-9282-451b-976e-3045920be150 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received event network-vif-plugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8920b27d-cb90-446e-8faf-fb843f088e22 req-f091616d-9282-451b-976e-3045920be150 service nova] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8920b27d-cb90-446e-8faf-fb843f088e22 req-f091616d-9282-451b-976e-3045920be150 service nova] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8920b27d-cb90-446e-8faf-fb843f088e22 req-f091616d-9282-451b-976e-3045920be150 service nova] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-8920b27d-cb90-446e-8faf-fb843f088e22 req-f091616d-9282-451b-976e-3045920be150 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] No waiting events found dispatching network-vif-plugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:42 user nova-compute[76161]: WARNING nova.compute.manager [req-8920b27d-cb90-446e-8faf-fb843f088e22 req-f091616d-9282-451b-976e-3045920be150 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received unexpected event network-vif-plugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 for instance with vm_state building and task_state spawning.
Nov 14 17:57:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:57:44 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Instance spawned successfully.
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.compute.manager [req-bb5431fb-bc4c-46d7-997f-606b1c537852 req-4200b889-ba38-4fa7-8ca8-5215cd75f2ab service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received event network-vif-plugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bb5431fb-bc4c-46d7-997f-606b1c537852 req-4200b889-ba38-4fa7-8ca8-5215cd75f2ab service nova] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bb5431fb-bc4c-46d7-997f-606b1c537852 req-4200b889-ba38-4fa7-8ca8-5215cd75f2ab service nova] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bb5431fb-bc4c-46d7-997f-606b1c537852 req-4200b889-ba38-4fa7-8ca8-5215cd75f2ab service nova] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.compute.manager [req-bb5431fb-bc4c-46d7-997f-606b1c537852 req-4200b889-ba38-4fa7-8ca8-5215cd75f2ab service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] No waiting events found dispatching network-vif-plugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:44 user nova-compute[76161]: WARNING nova.compute.manager [req-bb5431fb-bc4c-46d7-997f-606b1c537852 req-4200b889-ba38-4fa7-8ca8-5215cd75f2ab service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received unexpected event network-vif-plugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 for instance with vm_state building and task_state spawning.
Nov 14 17:57:44 user nova-compute[76161]: INFO nova.compute.manager [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 14 17:57:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:45 user nova-compute[76161]: INFO nova.compute.manager [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Took 6.14 seconds to build instance.
Nov 14 17:57:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-396b9f10-4e84-4156-9722-396c22aff1a4 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.362s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:57:45 user nova-compute[76161]: INFO nova.compute.claims [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Claim successful on node user
Nov 14 17:57:45 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:57:45 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:57:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:57:45 user nova-compute[76161]: DEBUG nova.policy [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b6eb8d881b84217b0e138def245cab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39dc84f83d834a618106830659fee331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:57:45 user nova-compute[76161]: INFO nova.virt.block_device [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Booting with volume 0e4f3142-43f5-498f-aeb1-fb864728fb4a at /dev/vda
Nov 14 17:57:46 user nova-compute[76161]: DEBUG os_brick.utils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68ca262-c156-4a40-86ae-129028c3ffc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6076cb-6747-4a99-bb2f-cc189e453979]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1808c458-6254-42e4-9fd5-5b65395acbd0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e048d98c-5312-4a06-bb01-67c42c0797f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:57:46 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:57:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1213c762-effb-4971-9edc-097ac0dec13e]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG os_brick.utils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating existing volume attachment record: dc94ca31-9d7b-4de1-bd06-a8e92f7a8d8b {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:46 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Successfully created port: 17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Successfully updated port: 17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquired lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-b46fb789-9b46-4e5e-b5d9-0741e382b724 req-4b3082c2-0587-49d8-a33b-42554fa379d8 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-changed-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-b46fb789-9b46-4e5e-b5d9-0741e382b724 req-4b3082c2-0587-49d8-a33b-42554fa379d8 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Refreshing instance network info cache due to event network-changed-17a4e939-dd34-4c8e-b254-079202ca1814. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b46fb789-9b46-4e5e-b5d9-0741e382b724 req-4b3082c2-0587-49d8-a33b-42554fa379d8 service nova] Acquiring lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating instance_info_cache with network_info: [{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Releasing lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Instance network_info: |[{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b46fb789-9b46-4e5e-b5d9-0741e382b724 req-4b3082c2-0587-49d8-a33b-42554fa379d8 service nova] Acquired lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:47 user nova-compute[76161]: DEBUG nova.network.neutron [req-b46fb789-9b46-4e5e-b5d9-0741e382b724 req-4b3082c2-0587-49d8-a33b-42554fa379d8 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Refreshing network info cache for port 17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "385ef873-fc1f-46ae-90da-b75f82524b99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "385ef873-fc1f-46ae-90da-b75f82524b99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG nova.network.neutron [req-b46fb789-9b46-4e5e-b5d9-0741e382b724 req-4b3082c2-0587-49d8-a33b-42554fa379d8 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updated VIF entry in instance network info cache for port 17a4e939-dd34-4c8e-b254-079202ca1814. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG nova.network.neutron [req-b46fb789-9b46-4e5e-b5d9-0741e382b724 req-4b3082c2-0587-49d8-a33b-42554fa379d8 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating instance_info_cache with network_info: [{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:57:48 user nova-compute[76161]: INFO nova.compute.claims [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Claim successful on node user
Nov 14 17:57:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b46fb789-9b46-4e5e-b5d9-0741e382b724 req-4b3082c2-0587-49d8-a33b-42554fa379d8 service nova] Releasing lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:57:49 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:57:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG nova.policy [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4714975d06d8455788463a30e9bc5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69696059b86f44b7ae274bf8274f9843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:57:49 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Creating image(s)
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "/opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "/opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "/opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Successfully created port: 50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk 1073741824" returned: 0 in 0.054s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:57:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Cannot resize image /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Ensure instance console log exists: /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Successfully updated port: 50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "refresh_cache-385ef873-fc1f-46ae-90da-b75f82524b99" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquired lock "refresh_cache-385ef873-fc1f-46ae-90da-b75f82524b99" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-28192a27-f0bd-476a-aba9-e5b9b6fa3261 req-7c29d366-b969-474b-9d50-3e14e8ec4812 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Received event network-changed-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-28192a27-f0bd-476a-aba9-e5b9b6fa3261 req-7c29d366-b969-474b-9d50-3e14e8ec4812 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Refreshing instance network info cache due to event network-changed-50dbbfa6-c6cd-400f-947c-4b0036b6bc22. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-28192a27-f0bd-476a-aba9-e5b9b6fa3261 req-7c29d366-b969-474b-9d50-3e14e8ec4812 service nova] Acquiring lock "refresh_cache-385ef873-fc1f-46ae-90da-b75f82524b99" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Updating instance_info_cache with network_info: [{"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Releasing lock "refresh_cache-385ef873-fc1f-46ae-90da-b75f82524b99" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Instance network_info: |[{"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-28192a27-f0bd-476a-aba9-e5b9b6fa3261 req-7c29d366-b969-474b-9d50-3e14e8ec4812 service nova] Acquired lock "refresh_cache-385ef873-fc1f-46ae-90da-b75f82524b99" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.network.neutron [req-28192a27-f0bd-476a-aba9-e5b9b6fa3261 req-7c29d366-b969-474b-9d50-3e14e8ec4812 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Refreshing network info cache for port 50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Start _get_guest_xml network_info=[{"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:57:50 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:50 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2119915686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2119915686',id=28,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-27wx0uw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:57:49Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=385ef873-fc1f-46ae-90da-b75f82524b99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:85:5b,bridge_name='br-int',has_traffic_filtering=True,id=50dbbfa6-c6cd-400f-947c-4b0036b6bc22,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dbbfa6-c6') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'pci_devices' on Instance uuid 385ef873-fc1f-46ae-90da-b75f82524b99 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:57:50 user nova-compute[76161]:   <uuid>385ef873-fc1f-46ae-90da-b75f82524b99</uuid>
Nov 14 17:57:50 user nova-compute[76161]:   <name>instance-0000001c</name>
Nov 14 17:57:50 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:57:50 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:57:50 user nova-compute[76161]:   <metadata>
Nov 14 17:57:50 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:57:50 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:57:50 user nova-compute[76161]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2119915686</nova:name>
Nov 14 17:57:50 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:57:50</nova:creationTime>
Nov 14 17:57:50 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:57:50 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:57:50 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:57:50 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:57:50 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:57:50 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:57:50 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:57:50 user nova-compute[76161]:       <nova:owner>
Nov 14 17:57:50 user nova-compute[76161]:         <nova:user uuid="4714975d06d8455788463a30e9bc5faa">tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member</nova:user>
Nov 14 17:57:50 user nova-compute[76161]:         <nova:project uuid="69696059b86f44b7ae274bf8274f9843">tempest-ServerBootFromVolumeStableRescueTest-500586355</nova:project>
Nov 14 17:57:50 user nova-compute[76161]:       </nova:owner>
Nov 14 17:57:50 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:57:50 user nova-compute[76161]:       <nova:ports>
Nov 14 17:57:50 user nova-compute[76161]:         <nova:port uuid="50dbbfa6-c6cd-400f-947c-4b0036b6bc22">
Nov 14 17:57:50 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 17:57:50 user nova-compute[76161]:         </nova:port>
Nov 14 17:57:50 user nova-compute[76161]:       </nova:ports>
Nov 14 17:57:50 user nova-compute[76161]:     </nova:instance>
Nov 14 17:57:50 user nova-compute[76161]:   </metadata>
Nov 14 17:57:50 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:57:50 user nova-compute[76161]:     <system>
Nov 14 17:57:50 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:57:50 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:57:50 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:57:50 user nova-compute[76161]:       <entry name="serial">385ef873-fc1f-46ae-90da-b75f82524b99</entry>
Nov 14 17:57:50 user nova-compute[76161]:       <entry name="uuid">385ef873-fc1f-46ae-90da-b75f82524b99</entry>
Nov 14 17:57:50 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:57:50 user nova-compute[76161]:     </system>
Nov 14 17:57:50 user nova-compute[76161]:   </sysinfo>
Nov 14 17:57:50 user nova-compute[76161]:   <os>
Nov 14 17:57:50 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:57:50 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:57:50 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:57:50 user nova-compute[76161]:   </os>
Nov 14 17:57:50 user nova-compute[76161]:   <features>
Nov 14 17:57:50 user nova-compute[76161]:     <acpi/>
Nov 14 17:57:50 user nova-compute[76161]:     <apic/>
Nov 14 17:57:50 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:57:50 user nova-compute[76161]:   </features>
Nov 14 17:57:50 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:57:50 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:57:50 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:57:50 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:57:50 user nova-compute[76161]:   </clock>
Nov 14 17:57:50 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:57:50 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:57:50 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:57:50 user nova-compute[76161]:   </cpu>
Nov 14 17:57:50 user nova-compute[76161]:   <devices>
Nov 14 17:57:50 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:57:50 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:57:50 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk"/>
Nov 14 17:57:50 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:57:50 user nova-compute[76161]:     </disk>
Nov 14 17:57:50 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:57:50 user nova-compute[76161]:       <mac address="fa:16:3e:b4:85:5b"/>
Nov 14 17:57:50 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:57:50 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:57:50 user nova-compute[76161]:       <target dev="tap50dbbfa6-c6"/>
Nov 14 17:57:50 user nova-compute[76161]:     </interface>
Nov 14 17:57:50 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:57:50 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/console.log" append="off"/>
Nov 14 17:57:50 user nova-compute[76161]:     </serial>
Nov 14 17:57:50 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:57:50 user nova-compute[76161]:     <video>
Nov 14 17:57:50 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:57:50 user nova-compute[76161]:     </video>
Nov 14 17:57:50 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:57:50 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:57:50 user nova-compute[76161]:     </rng>
Nov 14 17:57:50 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:57:50 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:57:50 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:57:50 user nova-compute[76161]:     </memballoon>
Nov 14 17:57:50 user nova-compute[76161]:   </devices>
Nov 14 17:57:50 user nova-compute[76161]: </domain>
Nov 14 17:57:50 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2119915686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2119915686',id=28,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-27wx0uw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:57:49Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=385ef873-fc1f-46ae-90da-b75f82524b99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:85:5b,bridge_name='br-int',has_traffic_filtering=True,id=50dbbfa6-c6cd-400f-947c-4b0036b6bc22,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dbbfa6-c6') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG os_vif [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:85:5b,bridge_name='br-int',has_traffic_filtering=True,id=50dbbfa6-c6cd-400f-947c-4b0036b6bc22,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dbbfa6-c6') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fc480c2-40e4-547b-a79b-616e3f2b792f', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50dbbfa6-c6, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50dbbfa6-c6, col_values=(('qos', UUID('49c80498-6c54-469c-a994-54e9a5d40563')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50dbbfa6-c6, col_values=(('external_ids', {'iface-id': '50dbbfa6-c6cd-400f-947c-4b0036b6bc22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:85:5b', 'vm-uuid': '385ef873-fc1f-46ae-90da-b75f82524b99'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:50 user nova-compute[76161]: INFO os_vif [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:85:5b,bridge_name='br-int',has_traffic_filtering=True,id=50dbbfa6-c6cd-400f-947c-4b0036b6bc22,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dbbfa6-c6')
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:57:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No VIF found with MAC fa:16:3e:b4:85:5b, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-28192a27-f0bd-476a-aba9-e5b9b6fa3261 req-7c29d366-b969-474b-9d50-3e14e8ec4812 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Updated VIF entry in instance network info cache for port 50dbbfa6-c6cd-400f-947c-4b0036b6bc22. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-28192a27-f0bd-476a-aba9-e5b9b6fa3261 req-7c29d366-b969-474b-9d50-3e14e8ec4812 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Updating instance_info_cache with network_info: [{"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-28192a27-f0bd-476a-aba9-e5b9b6fa3261 req-7c29d366-b969-474b-9d50-3e14e8ec4812 service nova] Releasing lock "refresh_cache-385ef873-fc1f-46ae-90da-b75f82524b99" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:57:51 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Creating image(s)
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Ensure instance console log exists: /opt/stack/data/nova/instances/c6f53da9-e029-4aa7-8dad-edd41eb2eb5d/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Start _get_guest_xml network_info=[{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrmvRgVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c6f53da9-e029-4aa7-8dad-edd41eb2eb5d', 'attached_at': '', 'detached_at': '', 'volume_id': '0e4f3142-43f5-498f-aeb1-fb864728fb4a', 'serial': '0e4f3142-43f5-498f-aeb1-fb864728fb4a'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'dc94ca31-9d7b-4de1-bd06-a8e92f7a8d8b', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:57:51 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:51 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrmvRgVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:57:51 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:57:51 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:57:51 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb66bc66-9273-4ffe-91c8-323dd1659cf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:57:51 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[58792ff9-e44c-42f4-874a-e933d0a1cf4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a] added
Nov 14 17:57:51 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8238e563-a980-41ac-a6d4-a23155167f5a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75d6893-440c-45a7-8295-9873bfcf1b24]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrmvRgVA {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrmvRgVA" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0902d4cf-9804-4c7c-bf29-0fb2e78f8266]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrmvRgVA'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca10eeac-2c2b-4ae1-92ef-6e8235ce9996]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb7dbef-9522-469f-a569-93c53465cadb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad5c6be-1526-44a2-a80e-c8bf4c88803f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260]
Nov 14 17:57:51 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260] successful.
Nov 14 17:57:51 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afb4a87-85df-4321-a008-b1d40b1d76ae]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f684e9a9-805e-413d-bcfe-c4a7bcf4c6fe]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:57:51 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:57:51 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:57:51 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc72ed1-83f3-4224-977f-9fdad1fb9fb0]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:57:51 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrmvRgVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-03de81f9-ee5a-4068-9ab1-10ed627e6463 req-b683c2a6-6407-47ec-8697-b090e1974485 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Received event network-vif-plugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-03de81f9-ee5a-4068-9ab1-10ed627e6463 req-b683c2a6-6407-47ec-8697-b090e1974485 service nova] Acquiring lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-03de81f9-ee5a-4068-9ab1-10ed627e6463 req-b683c2a6-6407-47ec-8697-b090e1974485 service nova] Lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-03de81f9-ee5a-4068-9ab1-10ed627e6463 req-b683c2a6-6407-47ec-8697-b090e1974485 service nova] Lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-03de81f9-ee5a-4068-9ab1-10ed627e6463 req-b683c2a6-6407-47ec-8697-b090e1974485 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] No waiting events found dispatching network-vif-plugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:52 user nova-compute[76161]: WARNING nova.compute.manager [req-03de81f9-ee5a-4068-9ab1-10ed627e6463 req-b683c2a6-6407-47ec-8697-b090e1974485 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Received unexpected event network-vif-plugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 for instance with vm_state building and task_state spawning.
Nov 14 17:57:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23462663365396237', 'path': '/dev/sdf'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462663365396237', 'path': '/dev/sdf'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-971044589',display_name='tempest-TestShelveInstance-server-971044589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-971044589',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACZLnDoDR2XNy/4jmfnxkmNhDJA1P9Br59clEYGiQHmDpGAVt5kNhXg5880Zep/dKONHa3tuwi8zStSfZ3O5TInSOxnWMhNTx/hE1EfctdbeJS8CuZ6VujHjO3E2quKbQ==',key_name='tempest-TestShelveInstance-2116969338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39dc84f83d834a618106830659fee331',ramdisk_id='',reservation_id='r-05v9kppj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1328804028',owner_user_name='tempest-TestShelveInstance-1328804028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:57:46Z,user_data=None,user_id='5b6eb8d881b84217b0e138def245cab0',uuid=c6f53da9-e029-4aa7-8dad-edd41eb2eb5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converting VIF {"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lazy-loading 'pci_devices' on Instance uuid c6f53da9-e029-4aa7-8dad-edd41eb2eb5d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:57:52 user nova-compute[76161]:   <uuid>c6f53da9-e029-4aa7-8dad-edd41eb2eb5d</uuid>
Nov 14 17:57:52 user nova-compute[76161]:   <name>instance-0000001b</name>
Nov 14 17:57:52 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:57:52 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:57:52 user nova-compute[76161]:   <metadata>
Nov 14 17:57:52 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:57:52 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:57:52 user nova-compute[76161]:       <nova:name>tempest-TestShelveInstance-server-971044589</nova:name>
Nov 14 17:57:52 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:57:51</nova:creationTime>
Nov 14 17:57:52 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:57:52 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:57:52 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:57:52 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:57:52 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:57:52 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:57:52 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:57:52 user nova-compute[76161]:       <nova:owner>
Nov 14 17:57:52 user nova-compute[76161]:         <nova:user uuid="5b6eb8d881b84217b0e138def245cab0">tempest-TestShelveInstance-1328804028-project-member</nova:user>
Nov 14 17:57:52 user nova-compute[76161]:         <nova:project uuid="39dc84f83d834a618106830659fee331">tempest-TestShelveInstance-1328804028</nova:project>
Nov 14 17:57:52 user nova-compute[76161]:       </nova:owner>
Nov 14 17:57:52 user nova-compute[76161]:       <nova:ports>
Nov 14 17:57:52 user nova-compute[76161]:         <nova:port uuid="17a4e939-dd34-4c8e-b254-079202ca1814">
Nov 14 17:57:52 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 17:57:52 user nova-compute[76161]:         </nova:port>
Nov 14 17:57:52 user nova-compute[76161]:       </nova:ports>
Nov 14 17:57:52 user nova-compute[76161]:     </nova:instance>
Nov 14 17:57:52 user nova-compute[76161]:   </metadata>
Nov 14 17:57:52 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:57:52 user nova-compute[76161]:     <system>
Nov 14 17:57:52 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:57:52 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:57:52 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:57:52 user nova-compute[76161]:       <entry name="serial">c6f53da9-e029-4aa7-8dad-edd41eb2eb5d</entry>
Nov 14 17:57:52 user nova-compute[76161]:       <entry name="uuid">c6f53da9-e029-4aa7-8dad-edd41eb2eb5d</entry>
Nov 14 17:57:52 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:57:52 user nova-compute[76161]:     </system>
Nov 14 17:57:52 user nova-compute[76161]:   </sysinfo>
Nov 14 17:57:52 user nova-compute[76161]:   <os>
Nov 14 17:57:52 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:57:52 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:57:52 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:57:52 user nova-compute[76161]:   </os>
Nov 14 17:57:52 user nova-compute[76161]:   <features>
Nov 14 17:57:52 user nova-compute[76161]:     <acpi/>
Nov 14 17:57:52 user nova-compute[76161]:     <apic/>
Nov 14 17:57:52 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:57:52 user nova-compute[76161]:   </features>
Nov 14 17:57:52 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:57:52 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:57:52 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:57:52 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:57:52 user nova-compute[76161]:   </clock>
Nov 14 17:57:52 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:57:52 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:57:52 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:57:52 user nova-compute[76161]:   </cpu>
Nov 14 17:57:52 user nova-compute[76161]:   <devices>
Nov 14 17:57:52 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 17:57:52 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:57:52 user nova-compute[76161]:       <source dev="/dev/sdf"/>
Nov 14 17:57:52 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:57:52 user nova-compute[76161]:       <serial>0e4f3142-43f5-498f-aeb1-fb864728fb4a</serial>
Nov 14 17:57:52 user nova-compute[76161]:     </disk>
Nov 14 17:57:52 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:57:52 user nova-compute[76161]:       <mac address="fa:16:3e:f0:bd:0b"/>
Nov 14 17:57:52 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:57:52 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:57:52 user nova-compute[76161]:       <target dev="tap17a4e939-dd"/>
Nov 14 17:57:52 user nova-compute[76161]:     </interface>
Nov 14 17:57:52 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:57:52 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/c6f53da9-e029-4aa7-8dad-edd41eb2eb5d/console.log" append="off"/>
Nov 14 17:57:52 user nova-compute[76161]:     </serial>
Nov 14 17:57:52 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:57:52 user nova-compute[76161]:     <video>
Nov 14 17:57:52 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:57:52 user nova-compute[76161]:     </video>
Nov 14 17:57:52 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:57:52 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:57:52 user nova-compute[76161]:     </rng>
Nov 14 17:57:52 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:57:52 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:57:52 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:57:52 user nova-compute[76161]:     </memballoon>
Nov 14 17:57:52 user nova-compute[76161]:   </devices>
Nov 14 17:57:52 user nova-compute[76161]: </domain>
Nov 14 17:57:52 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-971044589',display_name='tempest-TestShelveInstance-server-971044589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-971044589',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACZLnDoDR2XNy/4jmfnxkmNhDJA1P9Br59clEYGiQHmDpGAVt5kNhXg5880Zep/dKONHa3tuwi8zStSfZ3O5TInSOxnWMhNTx/hE1EfctdbeJS8CuZ6VujHjO3E2quKbQ==',key_name='tempest-TestShelveInstance-2116969338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39dc84f83d834a618106830659fee331',ramdisk_id='',reservation_id='r-05v9kppj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1328804028',owner_user_name='tempest-TestShelveInstance-1328804028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:57:46Z,user_data=None,user_id='5b6eb8d881b84217b0e138def245cab0',uuid=c6f53da9-e029-4aa7-8dad-edd41eb2eb5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converting VIF {"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG os_vif [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9a7653a-7182-5814-b86a-97410dc4ef37', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17a4e939-dd, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17a4e939-dd, col_values=(('qos', UUID('38478b1d-c958-4aa5-a7d4-32d5436d6644')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17a4e939-dd, col_values=(('external_ids', {'iface-id': '17a4e939-dd34-4c8e-b254-079202ca1814', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:bd:0b', 'vm-uuid': 'c6f53da9-e029-4aa7-8dad-edd41eb2eb5d'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:52 user nova-compute[76161]: INFO os_vif [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd')
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:57:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] No VIF found with MAC fa:16:3e:f0:bd:0b, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:57:53 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:57:53 user nova-compute[76161]: INFO nova.compute.manager [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] instance snapshotting
Nov 14 17:57:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Beginning live snapshot process
Nov 14 17:57:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json -f qcow2 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json -f qcow2 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprsg51uwq/c854b21bc6d4435fa2af5146268c3ad8.delta 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprsg51uwq/c854b21bc6d4435fa2af5146268c3ad8.delta 1073741824" returned: 0 in 0.074s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 17:57:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:57:54 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Instance spawned successfully.
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Received event network-vif-plugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] Acquiring lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] Lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] Lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] No waiting events found dispatching network-vif-plugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:54 user nova-compute[76161]: WARNING nova.compute.manager [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Received unexpected event network-vif-plugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 for instance with vm_state building and task_state spawning.
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] No waiting events found dispatching network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:54 user nova-compute[76161]: WARNING nova.compute.manager [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received unexpected event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 for instance with vm_state building and task_state spawning.
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] No waiting events found dispatching network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:54 user nova-compute[76161]: WARNING nova.compute.manager [req-e662d870-1b3b-44f6-b2f1-1d669d8437c9 req-056979c8-2dc9-4f46-901e-c11fbe3ebdda service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received unexpected event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 for instance with vm_state building and task_state spawning.
Nov 14 17:57:54 user nova-compute[76161]: INFO nova.compute.manager [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 14 17:57:54 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:54 user nova-compute[76161]: INFO nova.compute.manager [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Took 6.28 seconds to build instance.
Nov 14 17:57:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5ceb3f0-084e-4fbe-968d-7b5b699ce04e tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "385ef873-fc1f-46ae-90da-b75f82524b99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.375s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:57:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] COPY block job progress, current cursor: 23527424 final cursor: 75563008 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:57:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:57:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 17:57:56 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 17:57:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprsg51uwq/c854b21bc6d4435fa2af5146268c3ad8.delta /opt/stack/data/nova/instances/snapshots/tmprsg51uwq/c854b21bc6d4435fa2af5146268c3ad8 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprsg51uwq/c854b21bc6d4435fa2af5146268c3ad8.delta /opt/stack/data/nova/instances/snapshots/tmprsg51uwq/c854b21bc6d4435fa2af5146268c3ad8" returned: 0 in 0.624s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Snapshot extracted, beginning image upload
Nov 14 17:57:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:56 user nova-compute[76161]: INFO nova.compute.manager [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Terminating instance
Nov 14 17:57:56 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:57:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:57 user nova-compute[76161]: INFO nova.compute.manager [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Terminating instance
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-6b03cb1a-45d3-40c7-a367-10f1b683271e req-9627ad97-23c4-4a74-97ac-89d0b404e891 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-unplugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b03cb1a-45d3-40c7-a367-10f1b683271e req-9627ad97-23c4-4a74-97ac-89d0b404e891 service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b03cb1a-45d3-40c7-a367-10f1b683271e req-9627ad97-23c4-4a74-97ac-89d0b404e891 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b03cb1a-45d3-40c7-a367-10f1b683271e req-9627ad97-23c4-4a74-97ac-89d0b404e891 service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-6b03cb1a-45d3-40c7-a367-10f1b683271e req-9627ad97-23c4-4a74-97ac-89d0b404e891 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-unplugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-6b03cb1a-45d3-40c7-a367-10f1b683271e req-9627ad97-23c4-4a74-97ac-89d0b404e891 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-unplugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-eb1b01f2-aa1f-40bc-af48-094b766468f7 req-fdf8ea70-cf86-433a-b582-1b610834c728 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-vif-unplugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-eb1b01f2-aa1f-40bc-af48-094b766468f7 req-fdf8ea70-cf86-433a-b582-1b610834c728 service nova] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-eb1b01f2-aa1f-40bc-af48-094b766468f7 req-fdf8ea70-cf86-433a-b582-1b610834c728 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-eb1b01f2-aa1f-40bc-af48-094b766468f7 req-fdf8ea70-cf86-433a-b582-1b610834c728 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-eb1b01f2-aa1f-40bc-af48-094b766468f7 req-fdf8ea70-cf86-433a-b582-1b610834c728 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] No waiting events found dispatching network-vif-unplugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-eb1b01f2-aa1f-40bc-af48-094b766468f7 req-fdf8ea70-cf86-433a-b582-1b610834c728 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-vif-unplugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Instance spawned successfully.
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:57:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Instance destroyed successfully.
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lazy-loading 'resources' on Instance uuid 56f47238-81fe-4196-865c-e1ad68cf6fea {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-412733385',display_name='tempest-ServerActionsTestOtherB-server-412733385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-412733385',id=4,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0NZD4kqQvyUmQDlStvq04ezcWsfIyD0A/bWacUhJpYz5fcS1f2SC6UBuTPRJ8HEnEXX6nzxYwzXvCIrkT+ksrUBvLI5jLRbrB40MHHEGW3qMOyOEwSYMvxHD0HaK5eqA==',key_name='tempest-keypair-1585564500',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:55:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d05c015b22d142de91f43f92f00fe8f5',ramdisk_id='',reservation_id='r-ixxlkxwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2076940630',owner_user_name='tempest-ServerActionsTestOtherB-2076940630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:55:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdcf024ba5d2481aad966acad37d9275',uuid=56f47238-81fe-4196-865c-e1ad68cf6fea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converting VIF {"id": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "address": "fa:16:3e:27:c8:17", "network": {"id": "44750feb-ca02-4e57-994a-4d3332b9fafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884427334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05c015b22d142de91f43f92f00fe8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b86458-3c", "ovs_interfaceid": "39b86458-3c6f-457f-b2ba-e2f4709ffb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_vif [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39b86458-3c, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Instance destroyed successfully.
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lazy-loading 'resources' on Instance uuid a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65dd35f4-9e7b-4406-bfdc-5922228bf7d1) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1145779311',display_name='tempest-ServersNegativeTestJSON-server-1145779311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1145779311',id=2,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68afcd8a90ba42bd860204d31efae7e0',ramdisk_id='',reservation_id='r-t70n8d88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1371271005',owner_user_name='tempest-ServersNegativeTestJSON-1371271005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:49:34Z,user_data=None,user_id='983ee707e2eb4a2ba4617f91d810011d',uuid=a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converting VIF {"id": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "address": "fa:16:3e:89:2b:cf", "network": {"id": "b21dbfd4-69d6-45b0-abbb-b056988e8be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1908855686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68afcd8a90ba42bd860204d31efae7e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap670ed619-c2", "ovs_interfaceid": "670ed619-c20d-45af-a7c8-dc9d1d3172f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:2b:cf,bridge_name='br-int',has_traffic_filtering=True,id=670ed619-c20d-45af-a7c8-dc9d1d3172f9,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670ed619-c2') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_vif [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:2b:cf,bridge_name='br-int',has_traffic_filtering=True,id=670ed619-c20d-45af-a7c8-dc9d1d3172f9,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670ed619-c2') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap670ed619-c2, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:58 user nova-compute[76161]: INFO os_vif [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c8:17,bridge_name='br-int',has_traffic_filtering=True,id=39b86458-3c6f-457f-b2ba-e2f4709ffb50,network=Network(44750feb-ca02-4e57-994a-4d3332b9fafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b86458-3c')
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38b4a0b4-df1d-4620-a6ea-e8bb72e9e7e5) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgBeLnrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:57:58 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:58 user nova-compute[76161]: INFO os_vif [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:2b:cf,bridge_name='br-int',has_traffic_filtering=True,id=670ed619-c20d-45af-a7c8-dc9d1d3172f9,network=Network(b21dbfd4-69d6-45b0-abbb-b056988e8be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap670ed619-c2')
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Deleting instance files /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d_del
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Deletion of /opt/stack/data/nova/instances/a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d_del complete
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.compute.manager [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Took 6.97 seconds to spawn the instance on the hypervisor.
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df08541-9f93-4e45-9ad2-c32d5aac28b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:57:58 user nova-compute[76161]: No targets found.
Nov 14 17:57:58 user nova-compute[76161]: iSNS:
Nov 14 17:57:58 user nova-compute[76161]: No targets found.
Nov 14 17:57:58 user nova-compute[76161]: STATIC:
Nov 14 17:57:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8
Nov 14 17:57:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:57:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:57:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1
Nov 14 17:57:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:57:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:57:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:57:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:57:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:57:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 17:57:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:57:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:57:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:57:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:57:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:57:58 user nova-compute[76161]: FIRMWARE:
Nov 14 17:57:58 user nova-compute[76161]: No targets found.
Nov 14 17:57:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:57:58 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:57:58 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3defc61c-e479-4fdd-b29a-c0212f789f55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db33ecc-7b0b-4d33-a5d0-66847ec751c8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:57:58 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:57:58 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:57:58 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:57:58 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:57:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:57:58 user nova-compute[76161]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 (non-flash)
Nov 14 17:57:58 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:57:58 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:57:58 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:57:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f81da680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.compute.manager [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.compute.manager [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Took 12.98 seconds to build instance.
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[781e001e-88e9-4dc0-b762-5d39ef28c208]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e8e62805-5294-4467-8944-77c6613c29f8 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.074s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e6a48f-1d94-4ade-84b3-96b11566e572]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d18915-b69b-4640-8940-1a9f0151e483]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e844e5-e98d-4298-9f56-e45dd37d27ee]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26072ba-1455-4992-9292-c78cf36c75ab]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d586d37f-7bf5-4c59-b9ef-3c7bf0767eeb]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260]
Nov 14 17:57:58 user nova-compute[76161]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1, portal: 172.16.0.220,3260] successful.
Nov 14 17:57:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96c39a9-1a04-42d8-8ae6-7738ced041a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcf7dd3-c570-441b-a3c9-1e05b1968bee]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] <== disconnect_volume: return (442ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Deleting instance files /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea_del
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Deletion of /opt/stack/data/nova/instances/56f47238-81fe-4196-865c-e1ad68cf6fea_del complete
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.compute.manager [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Took 1.84 seconds to destroy the instance on the hypervisor.
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Took 0.56 seconds to deallocate network for instance.
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-0615b50d-04cb-4328-8c97-bcfa21ff7f74 req-e27a442f-1594-430b-b660-f28238849e4c service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0615b50d-04cb-4328-8c97-bcfa21ff7f74 req-e27a442f-1594-430b-b660-f28238849e4c service nova] Acquiring lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0615b50d-04cb-4328-8c97-bcfa21ff7f74 req-e27a442f-1594-430b-b660-f28238849e4c service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0615b50d-04cb-4328-8c97-bcfa21ff7f74 req-e27a442f-1594-430b-b660-f28238849e4c service nova] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-0615b50d-04cb-4328-8c97-bcfa21ff7f74 req-e27a442f-1594-430b-b660-f28238849e4c service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] No waiting events found dispatching network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:59 user nova-compute[76161]: WARNING nova.compute.manager [req-0615b50d-04cb-4328-8c97-bcfa21ff7f74 req-e27a442f-1594-430b-b660-f28238849e4c service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received unexpected event network-vif-plugged-39b86458-3c6f-457f-b2ba-e2f4709ffb50 for instance with vm_state active and task_state deleting.
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-0615b50d-04cb-4328-8c97-bcfa21ff7f74 req-e27a442f-1594-430b-b660-f28238849e4c service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-vif-deleted-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:57:59 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Took 0.92 seconds to deallocate network for instance.
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] No waiting events found dispatching network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:59 user nova-compute[76161]: WARNING nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received unexpected event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 for instance with vm_state deleted and task_state None.
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] No waiting events found dispatching network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:59 user nova-compute[76161]: WARNING nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received unexpected event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 for instance with vm_state deleted and task_state None.
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] No waiting events found dispatching network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:59 user nova-compute[76161]: WARNING nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received unexpected event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 for instance with vm_state deleted and task_state None.
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-vif-unplugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] No waiting events found dispatching network-vif-unplugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:59 user nova-compute[76161]: WARNING nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received unexpected event network-vif-unplugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 for instance with vm_state deleted and task_state None.
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Acquiring lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] No waiting events found dispatching network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:57:59 user nova-compute[76161]: WARNING nova.compute.manager [req-567a6e29-04ee-4adb-a1d2-51b1c0df1f0c req-88269465-1c79-4374-8433-a8798704b6f8 service nova] [instance: a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d] Received unexpected event network-vif-plugged-670ed619-c20d-45af-a7c8-dc9d1d3172f9 for instance with vm_state deleted and task_state None.
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.789s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:57:59 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Deleted allocations for instance a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d
Nov 14 17:57:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4ba79d-883d-4aab-9b75-42b4aa7077b4 tempest-ServersNegativeTestJSON-1371271005 tempest-ServersNegativeTestJSON-1371271005-project-member] Lock "a7fcb3a6-3a0a-4950-b86c-cffd01d8f39d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.727s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:00 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Snapshot image upload complete
Nov 14 17:58:00 user nova-compute[76161]: INFO nova.compute.manager [None req-7b62464b-d24f-438f-8f41-7348d805cb32 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Took 7.28 seconds to snapshot the instance on the hypervisor.
Nov 14 17:58:00 user nova-compute[76161]: INFO nova.compute.manager [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Took 0.86 seconds to detach 1 volumes for instance.
Nov 14 17:58:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:00 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:58:00 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:58:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:01 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Deleted allocations for instance 56f47238-81fe-4196-865c-e1ad68cf6fea
Nov 14 17:58:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d7c1900b-8644-4804-9fef-b9296085b234 tempest-ServerActionsTestOtherB-2076940630 tempest-ServerActionsTestOtherB-2076940630-project-member] Lock "56f47238-81fe-4196-865c-e1ad68cf6fea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.297s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-127c2d6c-0cba-48d3-82e9-e4af8bd2e05b req-a6c02c90-6a14-49fb-a1f5-41d7d17d9144 service nova] [instance: 56f47238-81fe-4196-865c-e1ad68cf6fea] Received event network-vif-deleted-39b86458-3c6f-457f-b2ba-e2f4709ffb50 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:02 user nova-compute[76161]: INFO nova.compute.manager [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Detaching volume 6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:58:02 user nova-compute[76161]: INFO nova.compute.claims [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Claim successful on node user
Nov 14 17:58:02 user nova-compute[76161]: INFO nova.virt.block_device [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Attempting to driver detach volume 6d8ec367-5fa5-4318-9647-605d977d3ae7 from mountpoint /dev/vdb
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Attempting to detach device vdb from instance 56848a92-97b3-4eef-b924-de8ab85ad115 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:58:02 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:58:02 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 17:58:02 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:58:02 user nova-compute[76161]:   <serial>6d8ec367-5fa5-4318-9647-605d977d3ae7</serial>
Nov 14 17:58:02 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 17:58:02 user nova-compute[76161]: </disk>
Nov 14 17:58:02 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:58:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully detached device vdb from instance 56848a92-97b3-4eef-b924-de8ab85ad115 from the persistent domain config.
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56848a92-97b3-4eef-b924-de8ab85ad115 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:58:02 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:58:02 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 17:58:02 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:58:02 user nova-compute[76161]:   <serial>6d8ec367-5fa5-4318-9647-605d977d3ae7</serial>
Nov 14 17:58:02 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 17:58:02 user nova-compute[76161]: </disk>
Nov 14 17:58:02 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56848a92-97b3-4eef-b924-de8ab85ad115 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:58:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:58:02 user nova-compute[76161]: DEBUG nova.policy [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '220334ba1c7744c68e1bd8c2c5c20749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72de616ddd04286a9946e5727b76e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:58:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:58:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:58:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Creating image(s)
Nov 14 17:58:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "/opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "/opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "/opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "64682f6acfaa0d17122f6685446b745bbf545120" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "64682f6acfaa0d17122f6685446b745bbf545120" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120.part --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Successfully created port: 1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120.part --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG nova.virt.images [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] e9d20e5a-73d6-4594-a67f-86797c646768 was qcow2, converting to raw {{(pid=76161) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120.part /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120.converted {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120.part /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120.converted" returned: 0 in 0.596s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120.converted --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Successfully updated port: 1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquired lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:58:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "64682f6acfaa0d17122f6685446b745bbf545120" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.930s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-73ca2512-f509-46b2-8391-9fc06f236066 req-c5ef7ce3-83c4-4742-8380-148c0538f95c service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received event network-changed-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-73ca2512-f509-46b2-8391-9fc06f236066 req-c5ef7ce3-83c4-4742-8380-148c0538f95c service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Refreshing instance network info cache due to event network-changed-1b5e3434-bed5-4f47-8004-ed361e773df0. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-73ca2512-f509-46b2-8391-9fc06f236066 req-c5ef7ce3-83c4-4742-8380-148c0538f95c service nova] Acquiring lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120 --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "64682f6acfaa0d17122f6685446b745bbf545120" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "64682f6acfaa0d17122f6685446b745bbf545120" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Updating instance_info_cache with network_info: [{"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Releasing lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Instance network_info: |[{"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-73ca2512-f509-46b2-8391-9fc06f236066 req-c5ef7ce3-83c4-4742-8380-148c0538f95c service nova] Acquired lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-73ca2512-f509-46b2-8391-9fc06f236066 req-c5ef7ce3-83c4-4742-8380-148c0538f95c service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Refreshing network info cache for port 1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120 --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120,backing_fmt=raw /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120,backing_fmt=raw /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk 1073741824" returned: 0 in 0.047s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "64682f6acfaa0d17122f6685446b745bbf545120" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120 --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Ensure instance console log exists: /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Start _get_guest_xml network_info=[{"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5350ee0952056beaf5467a52bd11202a',container_format='bare',created_at=2023-11-14T17:57:53Z,direct_url=<?>,disk_format='qcow2',id=e9d20e5a-73d6-4594-a67f-86797c646768,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-654505485',owner='b72de616ddd04286a9946e5727b76e85',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T17:58:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'e9d20e5a-73d6-4594-a67f-86797c646768'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:58:05 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:58:05 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5350ee0952056beaf5467a52bd11202a',container_format='bare',created_at=2023-11-14T17:57:53Z,direct_url=<?>,disk_format='qcow2',id=e9d20e5a-73d6-4594-a67f-86797c646768,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-654505485',owner='b72de616ddd04286a9946e5727b76e85',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T17:58:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:58:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2071279675',display_name='tempest-TestStampPattern-server-2071279675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2071279675',id=29,image_ref='e9d20e5a-73d6-4594-a67f-86797c646768',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVn++uY914nMT4ppedFhS8d3dW25Wn2Uz3D0CtpuFA7uYKjt5LP3wVNJBoX8K7AIEJk32VFPhZsLSf9W5T1bKCgwU7sl5Ok2efZd0OuAxtFgTYFlNfvMQAY6AUQQc/vkg==',key_name='tempest-TestStampPattern-1685336557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b72de616ddd04286a9946e5727b76e85',ramdisk_id='',reservation_id='r-03prqqxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6e87b617-e12f-4c33-bd5d-8f1bc07c417b',image_min_disk='1',image_min_ram='0',image_owner_id='b72de616ddd04286a9946e5727b76e85',image_owner_project_name='tempest-TestStampPattern-1566874307',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1566874307-project-member',image_user_id='220334ba1c7744c68e1bd8c2c5c20749',network_allocated='True',owner_project_name='tempest-TestStampPattern-1566874307',owner_user_name='tempest-TestStampPattern-1566874307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:58:03Z,user_data=None,user_id='220334ba1c7744c68e1bd8c2c5c20749',uuid=2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converting VIF {"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=1b5e3434-bed5-4f47-8004-ed361e773df0,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5e3434-be') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.objects.instance [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lazy-loading 'pci_devices' on Instance uuid 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:58:05 user nova-compute[76161]:   <uuid>2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d</uuid>
Nov 14 17:58:05 user nova-compute[76161]:   <name>instance-0000001d</name>
Nov 14 17:58:05 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:58:05 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:58:05 user nova-compute[76161]:   <metadata>
Nov 14 17:58:05 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:58:05 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:58:05 user nova-compute[76161]:       <nova:name>tempest-TestStampPattern-server-2071279675</nova:name>
Nov 14 17:58:05 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:58:05</nova:creationTime>
Nov 14 17:58:05 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:58:05 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:58:05 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:58:05 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:58:05 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:58:05 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:58:05 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:58:05 user nova-compute[76161]:       <nova:owner>
Nov 14 17:58:05 user nova-compute[76161]:         <nova:user uuid="220334ba1c7744c68e1bd8c2c5c20749">tempest-TestStampPattern-1566874307-project-member</nova:user>
Nov 14 17:58:05 user nova-compute[76161]:         <nova:project uuid="b72de616ddd04286a9946e5727b76e85">tempest-TestStampPattern-1566874307</nova:project>
Nov 14 17:58:05 user nova-compute[76161]:       </nova:owner>
Nov 14 17:58:05 user nova-compute[76161]:       <nova:root type="image" uuid="e9d20e5a-73d6-4594-a67f-86797c646768"/>
Nov 14 17:58:05 user nova-compute[76161]:       <nova:ports>
Nov 14 17:58:05 user nova-compute[76161]:         <nova:port uuid="1b5e3434-bed5-4f47-8004-ed361e773df0">
Nov 14 17:58:05 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 17:58:05 user nova-compute[76161]:         </nova:port>
Nov 14 17:58:05 user nova-compute[76161]:       </nova:ports>
Nov 14 17:58:05 user nova-compute[76161]:     </nova:instance>
Nov 14 17:58:05 user nova-compute[76161]:   </metadata>
Nov 14 17:58:05 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:58:05 user nova-compute[76161]:     <system>
Nov 14 17:58:05 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:58:05 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:58:05 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:58:05 user nova-compute[76161]:       <entry name="serial">2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d</entry>
Nov 14 17:58:05 user nova-compute[76161]:       <entry name="uuid">2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d</entry>
Nov 14 17:58:05 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:58:05 user nova-compute[76161]:     </system>
Nov 14 17:58:05 user nova-compute[76161]:   </sysinfo>
Nov 14 17:58:05 user nova-compute[76161]:   <os>
Nov 14 17:58:05 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:58:05 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:58:05 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:58:05 user nova-compute[76161]:   </os>
Nov 14 17:58:05 user nova-compute[76161]:   <features>
Nov 14 17:58:05 user nova-compute[76161]:     <acpi/>
Nov 14 17:58:05 user nova-compute[76161]:     <apic/>
Nov 14 17:58:05 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:58:05 user nova-compute[76161]:   </features>
Nov 14 17:58:05 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:58:05 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:58:05 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:58:05 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:58:05 user nova-compute[76161]:   </clock>
Nov 14 17:58:05 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:58:05 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:58:05 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:58:05 user nova-compute[76161]:   </cpu>
Nov 14 17:58:05 user nova-compute[76161]:   <devices>
Nov 14 17:58:05 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:58:05 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:58:05 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk"/>
Nov 14 17:58:05 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:58:05 user nova-compute[76161]:     </disk>
Nov 14 17:58:05 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:58:05 user nova-compute[76161]:       <mac address="fa:16:3e:7c:c2:3a"/>
Nov 14 17:58:05 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:58:05 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:58:05 user nova-compute[76161]:       <target dev="tap1b5e3434-be"/>
Nov 14 17:58:05 user nova-compute[76161]:     </interface>
Nov 14 17:58:05 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:58:05 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/console.log" append="off"/>
Nov 14 17:58:05 user nova-compute[76161]:     </serial>
Nov 14 17:58:05 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:58:05 user nova-compute[76161]:     <video>
Nov 14 17:58:05 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:58:05 user nova-compute[76161]:     </video>
Nov 14 17:58:05 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:58:05 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:58:05 user nova-compute[76161]:     </rng>
Nov 14 17:58:05 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:58:05 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:58:05 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:58:05 user nova-compute[76161]:     </memballoon>
Nov 14 17:58:05 user nova-compute[76161]:   </devices>
Nov 14 17:58:05 user nova-compute[76161]: </domain>
Nov 14 17:58:05 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:58:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2071279675',display_name='tempest-TestStampPattern-server-2071279675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2071279675',id=29,image_ref='e9d20e5a-73d6-4594-a67f-86797c646768',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVn++uY914nMT4ppedFhS8d3dW25Wn2Uz3D0CtpuFA7uYKjt5LP3wVNJBoX8K7AIEJk32VFPhZsLSf9W5T1bKCgwU7sl5Ok2efZd0OuAxtFgTYFlNfvMQAY6AUQQc/vkg==',key_name='tempest-TestStampPattern-1685336557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b72de616ddd04286a9946e5727b76e85',ramdisk_id='',reservation_id='r-03prqqxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6e87b617-e12f-4c33-bd5d-8f1bc07c417b',image_min_disk='1',image_min_ram='0',image_owner_id='b72de616ddd04286a9946e5727b76e85',image_owner_project_name='tempest-TestStampPattern-1566874307',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1566874307-project-member',image_user_id='220334ba1c7744c68e1bd8c2c5c20749',network_allocated='True',owner_project_name='tempest-TestStampPattern-1566874307',owner_user_name='tempest-TestStampPattern-1566874307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:58:03Z,user_data=None,user_id='220334ba1c7744c68e1bd8c2c5c20749',uuid=2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converting VIF {"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=1b5e3434-bed5-4f47-8004-ed361e773df0,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5e3434-be') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG os_vif [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=1b5e3434-bed5-4f47-8004-ed361e773df0,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5e3434-be') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2793c327-a442-5a3e-8651-6cc2db037ef3', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b5e3434-be, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b5e3434-be, col_values=(('qos', UUID('6b58c262-9ab4-4387-bd13-3c20a0f1de0b')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b5e3434-be, col_values=(('external_ids', {'iface-id': '1b5e3434-bed5-4f47-8004-ed361e773df0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:c2:3a', 'vm-uuid': '2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-73ca2512-f509-46b2-8391-9fc06f236066 req-c5ef7ce3-83c4-4742-8380-148c0538f95c service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Updated VIF entry in instance network info cache for port 1b5e3434-bed5-4f47-8004-ed361e773df0. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-73ca2512-f509-46b2-8391-9fc06f236066 req-c5ef7ce3-83c4-4742-8380-148c0538f95c service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Updating instance_info_cache with network_info: [{"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:58:05 user nova-compute[76161]: INFO os_vif [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=1b5e3434-bed5-4f47-8004-ed361e773df0,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5e3434-be')
Nov 14 17:58:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-73ca2512-f509-46b2-8391-9fc06f236066 req-c5ef7ce3-83c4-4742-8380-148c0538f95c service nova] Releasing lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:58:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] No VIF found with MAC fa:16:3e:7c:c2:3a, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:58:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-693b7af0-9f68-4bed-9af0-6684b385b802 req-fb71eb16-3dca-4107-910c-3a635a256153 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received event network-vif-plugged-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:58:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-693b7af0-9f68-4bed-9af0-6684b385b802 req-fb71eb16-3dca-4107-910c-3a635a256153 service nova] Acquiring lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-693b7af0-9f68-4bed-9af0-6684b385b802 req-fb71eb16-3dca-4107-910c-3a635a256153 service nova] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-693b7af0-9f68-4bed-9af0-6684b385b802 req-fb71eb16-3dca-4107-910c-3a635a256153 service nova] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-693b7af0-9f68-4bed-9af0-6684b385b802 req-fb71eb16-3dca-4107-910c-3a635a256153 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] No waiting events found dispatching network-vif-plugged-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:58:07 user nova-compute[76161]: WARNING nova.compute.manager [req-693b7af0-9f68-4bed-9af0-6684b385b802 req-fb71eb16-3dca-4107-910c-3a635a256153 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received unexpected event network-vif-plugged-1b5e3434-bed5-4f47-8004-ed361e773df0 for instance with vm_state building and task_state spawning.
Nov 14 17:58:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:09 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:58:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:58:09 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Instance spawned successfully.
Nov 14 17:58:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:58:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:58:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:58:09 user nova-compute[76161]: INFO nova.compute.manager [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 14 17:58:09 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:58:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-8509ebd4-851d-4de2-9f11-c6d9fdf0c5b7 req-480c89cd-3cdc-463f-b90f-4c054fa4f620 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received event network-vif-plugged-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:58:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8509ebd4-851d-4de2-9f11-c6d9fdf0c5b7 req-480c89cd-3cdc-463f-b90f-4c054fa4f620 service nova] Acquiring lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8509ebd4-851d-4de2-9f11-c6d9fdf0c5b7 req-480c89cd-3cdc-463f-b90f-4c054fa4f620 service nova] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8509ebd4-851d-4de2-9f11-c6d9fdf0c5b7 req-480c89cd-3cdc-463f-b90f-4c054fa4f620 service nova] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-8509ebd4-851d-4de2-9f11-c6d9fdf0c5b7 req-480c89cd-3cdc-463f-b90f-4c054fa4f620 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] No waiting events found dispatching network-vif-plugged-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:58:09 user nova-compute[76161]: WARNING nova.compute.manager [req-8509ebd4-851d-4de2-9f11-c6d9fdf0c5b7 req-480c89cd-3cdc-463f-b90f-4c054fa4f620 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received unexpected event network-vif-plugged-1b5e3434-bed5-4f47-8004-ed361e773df0 for instance with vm_state building and task_state spawning.
Nov 14 17:58:09 user nova-compute[76161]: INFO nova.compute.manager [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Took 7.32 seconds to build instance.
Nov 14 17:58:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9d83dc2-b671-4043-bb79-6f2be65a0289 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.422s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "76193048-410d-4a59-9eb5-165d8ce0af6c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:11 user nova-compute[76161]: INFO nova.compute.manager [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Detaching volume ed314789-1cd9-44ce-bd41-d54d6db6a8f8
Nov 14 17:58:11 user nova-compute[76161]: INFO nova.virt.block_device [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Attempting to driver detach volume ed314789-1cd9-44ce-bd41-d54d6db6a8f8 from mountpoint /dev/vdb
Nov 14 17:58:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Attempting to detach device vdb from instance 76193048-410d-4a59-9eb5-165d8ce0af6c from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:58:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:58:11 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:58:11 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 17:58:11 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:58:11 user nova-compute[76161]:   <serial>ed314789-1cd9-44ce-bd41-d54d6db6a8f8</serial>
Nov 14 17:58:11 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:58:11 user nova-compute[76161]: </disk>
Nov 14 17:58:11 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:58:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully detached device vdb from instance 76193048-410d-4a59-9eb5-165d8ce0af6c from the persistent domain config.
Nov 14 17:58:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76193048-410d-4a59-9eb5-165d8ce0af6c from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:58:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:58:11 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:58:11 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 17:58:11 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:58:11 user nova-compute[76161]:   <serial>ed314789-1cd9-44ce-bd41-d54d6db6a8f8</serial>
Nov 14 17:58:11 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:58:11 user nova-compute[76161]: </disk>
Nov 14 17:58:11 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:58:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76193048-410d-4a59-9eb5-165d8ce0af6c {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:58:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:58:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:58:17 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:58:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:58:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:58:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:58:18 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updating instance_info_cache with network_info: [{"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:58:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:58:18 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:58:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:58:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:58:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:58:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:58:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:58:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:58:18 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:58:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:22 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 56848a92-97b3-4eef-b924-de8ab85ad115 is timed out.
Nov 14 17:58:22 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully detached device vdb from instance 56848a92-97b3-4eef-b924-de8ab85ad115 from the live domain config.
Nov 14 17:58:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXfclPUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:58:22 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:58:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3680f4f9-bbff-44bb-9747-03894a141ef1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:58:22 user nova-compute[76161]: No targets found.
Nov 14 17:58:22 user nova-compute[76161]: iSNS:
Nov 14 17:58:22 user nova-compute[76161]: No targets found.
Nov 14 17:58:22 user nova-compute[76161]: STATIC:
Nov 14 17:58:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8
Nov 14 17:58:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:58:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:58:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:58:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:58:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:58:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 17:58:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:58:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:58:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7
Nov 14 17:58:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:58:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:58:22 user nova-compute[76161]: FIRMWARE:
Nov 14 17:58:22 user nova-compute[76161]: No targets found.
Nov 14 17:58:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:58:22 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:58:22 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ce979-6602-4a89-8a79-783d41f672bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[934cd7e8-b3c8-4fd6-b688-f3fc02d5f6e5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:58:23 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:58:23 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:58:23 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:58:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:58:23 user nova-compute[76161]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 (non-flash)
Nov 14 17:58:23 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:58:23 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:58:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f81dbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c69a104-e25e-4976-80ef-0542003a4e97]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee1fa67-bacb-49f7-83df-34c106606cc3]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0db308-1094-4250-9303-4036e3f7bd24]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9843d5-0753-4fe0-bb08-6d32f52d6d2f]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a950da7-5afb-4e6b-9323-79f7d1736fa7]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec800e5-5a63-40c6-b11c-3d7888ca159c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260]
Nov 14 17:58:23 user nova-compute[76161]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7, portal: 172.16.0.220,3260] successful.
Nov 14 17:58:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8ec367-5fa5-4318-9647-605d977d3ae7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc8df0e-29e4-44d9-bfed-aa54fe51830b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== disconnect_volume: return (366ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'flavor' on Instance uuid 56848a92-97b3-4eef-b924-de8ab85ad115 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:58:24 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:58:24 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7110MB free_disk=25.11884307861328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d35a3c5a-c146-47f1-8fdb-f65cdd96be12 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.473s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 56848a92-97b3-4eef-b924-de8ab85ad115 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 76193048-410d-4a59-9eb5-165d8ce0af6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 75295499-8f99-4c9b-a556-c1287c61d8f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 952593b7-cc8b-4d50-8aa8-a50e385e088b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance c6f53da9-e029-4aa7-8dad-edd41eb2eb5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 385ef873-fc1f-46ae-90da-b75f82524b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:58:24 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:58:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:25 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:58:25 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:58:25 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:58:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:31 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 76193048-410d-4a59-9eb5-165d8ce0af6c is timed out.
Nov 14 17:58:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully detached device vdb from instance 76193048-410d-4a59-9eb5-165d8ce0af6c from the live domain config.
Nov 14 17:58:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kHNWROTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:58:31 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bfa63d-8035-4df0-b7c1-0447a618cfff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:58:31 user nova-compute[76161]: No targets found.
Nov 14 17:58:31 user nova-compute[76161]: iSNS:
Nov 14 17:58:31 user nova-compute[76161]: No targets found.
Nov 14 17:58:31 user nova-compute[76161]: STATIC:
Nov 14 17:58:31 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8
Nov 14 17:58:31 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:58:31 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:58:31 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:58:31 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:58:31 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:58:31 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 17:58:31 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:58:31 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:58:31 user nova-compute[76161]: FIRMWARE:
Nov 14 17:58:31 user nova-compute[76161]: No targets found.
Nov 14 17:58:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:58:31 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:58:31 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8262eb1f-e16a-461a-a12a-25dda7afc577]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3736dacc-8d7f-4730-8767-279ae2e74d90]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:58:31 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:58:31 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:58:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:58:31 user nova-compute[76161]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 (non-flash)
Nov 14 17:58:31 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:58:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f8422440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8'): ({'sde'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Removing single pathed devices sde {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[341d0f43-774d-49fa-96b0-e73cd8f46b66]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81a474d-1c81-4cd5-b751-fccbce93d2e0]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flushing IO for device /dev/sde {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8fcc00-0dc4-4444-9121-8c763b8bd413]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57c0167-e56d-4f37-ae6a-f55074a8f9fb]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a61e99b-c26d-4d1f-99dc-7e1cce859170]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:58:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[025c7c2c-1005-47be-b059-030d9a0cf684]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8, portal: 172.16.0.220,3260]
Nov 14 17:58:32 user nova-compute[76161]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8, portal: 172.16.0.220,3260] successful.
Nov 14 17:58:32 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed314789-1cd9-44ce-bd41-d54d6db6a8f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24fcf55-5bb9-4cc9-aec7-cbbbce4e6a6e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] <== disconnect_volume: return (307ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG nova.objects.instance [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'flavor' on Instance uuid 76193048-410d-4a59-9eb5-165d8ce0af6c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:58:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ad6a4a85-ea6b-4586-b53f-7a77f6ca4bd4 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.862s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:58:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:52 user nova-compute[76161]: INFO nova.compute.manager [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Terminating instance
Nov 14 17:58:52 user nova-compute[76161]: DEBUG nova.compute.manager [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:58:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-961216fd-ac68-407c-b3d3-e7970c6b5173 req-ae8dbf49-9a8a-4ee8-afd1-24e8d3b8ac24 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-vif-unplugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-961216fd-ac68-407c-b3d3-e7970c6b5173 req-ae8dbf49-9a8a-4ee8-afd1-24e8d3b8ac24 service nova] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-961216fd-ac68-407c-b3d3-e7970c6b5173 req-ae8dbf49-9a8a-4ee8-afd1-24e8d3b8ac24 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-961216fd-ac68-407c-b3d3-e7970c6b5173 req-ae8dbf49-9a8a-4ee8-afd1-24e8d3b8ac24 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-961216fd-ac68-407c-b3d3-e7970c6b5173 req-ae8dbf49-9a8a-4ee8-afd1-24e8d3b8ac24 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] No waiting events found dispatching network-vif-unplugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-961216fd-ac68-407c-b3d3-e7970c6b5173 req-ae8dbf49-9a8a-4ee8-afd1-24e8d3b8ac24 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-vif-unplugged-b2487e15-e0cf-4079-9baf-f522396ce976 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Instance destroyed successfully.
Nov 14 17:58:53 user nova-compute[76161]: DEBUG nova.objects.instance [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'resources' on Instance uuid 56848a92-97b3-4eef-b924-de8ab85ad115 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1095895513',display_name='tempest-ServerActionsTestOtherA-server-1304251250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1095895513',id=17,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnUVlrrKY796M2WQb0to34mVHtH8sawDJDiNWfGFXurDBDBklAQgDqd8pjjgIb+0Unj5c6grIFHGUanM3AOdi9gBLjHVsWn12jK6zqkIeGTVVB8fkRDE79sNBqkLYZt1g==',key_name='tempest-keypair-916935358',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:55:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-byfwoe9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:55:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=56848a92-97b3-4eef-b924-de8ab85ad115,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "b2487e15-e0cf-4079-9baf-f522396ce976", "address": "fa:16:3e:46:2d:e4", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2487e15-e0", "ovs_interfaceid": "b2487e15-e0cf-4079-9baf-f522396ce976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG os_vif [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2487e15-e0, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a121ea1-f8b8-4c72-bc2c-38d127959d01) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:53 user nova-compute[76161]: INFO os_vif [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:2d:e4,bridge_name='br-int',has_traffic_filtering=True,id=b2487e15-e0cf-4079-9baf-f522396ce976,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2487e15-e0')
Nov 14 17:58:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Deleting instance files /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115_del
Nov 14 17:58:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Deletion of /opt/stack/data/nova/instances/56848a92-97b3-4eef-b924-de8ab85ad115_del complete
Nov 14 17:58:53 user nova-compute[76161]: INFO nova.compute.manager [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 17:58:53 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:58:53 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:58:54 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:58:54 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Took 0.91 seconds to deallocate network for instance.
Nov 14 17:58:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-5bdb9bdf-d724-4879-8b1a-6941a2d77e2d req-c591e55d-96cc-465b-a1e3-0a4fc133b774 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-vif-deleted-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:58:54 user nova-compute[76161]: INFO nova.compute.manager [req-5bdb9bdf-d724-4879-8b1a-6941a2d77e2d req-c591e55d-96cc-465b-a1e3-0a4fc133b774 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Neutron deleted interface b2487e15-e0cf-4079-9baf-f522396ce976; detaching it from the instance and deleting it from the info cache
Nov 14 17:58:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-5bdb9bdf-d724-4879-8b1a-6941a2d77e2d req-c591e55d-96cc-465b-a1e3-0a4fc133b774 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:58:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-5bdb9bdf-d724-4879-8b1a-6941a2d77e2d req-c591e55d-96cc-465b-a1e3-0a4fc133b774 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Detach interface failed, port_id=b2487e15-e0cf-4079-9baf-f522396ce976, reason: Instance 56848a92-97b3-4eef-b924-de8ab85ad115 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:58:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:54 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:58:54 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:58:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:54 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Deleted allocations for instance 56848a92-97b3-4eef-b924-de8ab85ad115
Nov 14 17:58:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-40fb9955-0fc4-4535-9808-103ff66599b9 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "56848a92-97b3-4eef-b924-de8ab85ad115" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.460s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-c346c33d-cc88-4ac7-ba72-a7a46c1a7fd1 req-9cd804d0-bf4c-42f6-818f-45639111b207 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:58:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c346c33d-cc88-4ac7-ba72-a7a46c1a7fd1 req-9cd804d0-bf4c-42f6-818f-45639111b207 service nova] Acquiring lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:58:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c346c33d-cc88-4ac7-ba72-a7a46c1a7fd1 req-9cd804d0-bf4c-42f6-818f-45639111b207 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:58:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c346c33d-cc88-4ac7-ba72-a7a46c1a7fd1 req-9cd804d0-bf4c-42f6-818f-45639111b207 service nova] Lock "56848a92-97b3-4eef-b924-de8ab85ad115-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:58:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-c346c33d-cc88-4ac7-ba72-a7a46c1a7fd1 req-9cd804d0-bf4c-42f6-818f-45639111b207 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] No waiting events found dispatching network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:58:55 user nova-compute[76161]: WARNING nova.compute.manager [req-c346c33d-cc88-4ac7-ba72-a7a46c1a7fd1 req-9cd804d0-bf4c-42f6-818f-45639111b207 service nova] [instance: 56848a92-97b3-4eef-b924-de8ab85ad115] Received unexpected event network-vif-plugged-b2487e15-e0cf-4079-9baf-f522396ce976 for instance with vm_state deleted and task_state None.
Nov 14 17:58:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-b6434909-27a4-4d81-9111-3050457e5b01 req-e9346bd7-4b42-42ec-8941-bdadbf06adb7 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-changed-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:58:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-b6434909-27a4-4d81-9111-3050457e5b01 req-e9346bd7-4b42-42ec-8941-bdadbf06adb7 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Refreshing instance network info cache due to event network-changed-d9c3c5f8-f77b-4475-9693-c63f6e310d19. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:58:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b6434909-27a4-4d81-9111-3050457e5b01 req-e9346bd7-4b42-42ec-8941-bdadbf06adb7 service nova] Acquiring lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:58:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b6434909-27a4-4d81-9111-3050457e5b01 req-e9346bd7-4b42-42ec-8941-bdadbf06adb7 service nova] Acquired lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:58:58 user nova-compute[76161]: DEBUG nova.network.neutron [req-b6434909-27a4-4d81-9111-3050457e5b01 req-e9346bd7-4b42-42ec-8941-bdadbf06adb7 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Refreshing network info cache for port d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:58:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:58:59 user nova-compute[76161]: DEBUG nova.network.neutron [req-b6434909-27a4-4d81-9111-3050457e5b01 req-e9346bd7-4b42-42ec-8941-bdadbf06adb7 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updated VIF entry in instance network info cache for port d9c3c5f8-f77b-4475-9693-c63f6e310d19. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:58:59 user nova-compute[76161]: DEBUG nova.network.neutron [req-b6434909-27a4-4d81-9111-3050457e5b01 req-e9346bd7-4b42-42ec-8941-bdadbf06adb7 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updating instance_info_cache with network_info: [{"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:58:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b6434909-27a4-4d81-9111-3050457e5b01 req-e9346bd7-4b42-42ec-8941-bdadbf06adb7 service nova] Releasing lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:00 user nova-compute[76161]: INFO nova.compute.manager [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Attaching volume b0aadcea-0bc4-46b4-b4a5-77abc43079a8 to /dev/vdb
Nov 14 17:59:00 user nova-compute[76161]: DEBUG os_brick.utils [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6471ff-9ce9-4553-8de6-43327cb57149]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[530e036c-a8ed-4cd8-a355-c47a54ca0daa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ebdb5a-7dab-4639-8cf3-5df8187160c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b1783d-109b-4e84-b6a5-36ea4472ba06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:59:01 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d1adf9-82a4-4342-99a7-384e736ede3f]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG os_brick.utils [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updating existing volume attachment record: fd7b93c0-2533-483d-b7db-2e3a51112f21 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "76193048-410d-4a59-9eb5-165d8ce0af6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "76193048-410d-4a59-9eb5-165d8ce0af6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:01 user nova-compute[76161]: INFO nova.compute.manager [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Terminating instance
Nov 14 17:59:01 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:59:01 user nova-compute[76161]: INFO nova.compute.claims [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Claim successful on node user
Nov 14 17:59:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Instance destroyed successfully.
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.objects.instance [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'resources' on Instance uuid 76193048-410d-4a59-9eb5-165d8ce0af6c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:53:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1852126971',display_name='tempest-AttachVolumeNegativeTest-server-1852126971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1852126971',id=18,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkxDmqkciezk7nmv7ve9Z75zLZQOesYe3Q27FmxijAfMJUz44IJ/xq7zGnUgc2B2rw39xEgFXCEkYWXlaZeam2cofMSEVPt4utWrlcaeRArd1sz7pQ2HmsLIMcL1Cnovg==',key_name='tempest-keypair-340133556',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:53:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-ej2crvhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:53:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=76193048-410d-4a59-9eb5-165d8ce0af6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "address": "fa:16:3e:f3:37:1d", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87d00b4-39", "ovs_interfaceid": "d87d00b4-392b-4b9d-8fb3-20c3dfe59894", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:37:1d,bridge_name='br-int',has_traffic_filtering=True,id=d87d00b4-392b-4b9d-8fb3-20c3dfe59894,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87d00b4-39') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG os_vif [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:37:1d,bridge_name='br-int',has_traffic_filtering=True,id=d87d00b4-392b-4b9d-8fb3-20c3dfe59894,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87d00b4-39') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd87d00b4-39, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b39be43-743b-4341-92fd-c21ceb0e43d0) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:02 user nova-compute[76161]: INFO os_vif [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:37:1d,bridge_name='br-int',has_traffic_filtering=True,id=d87d00b4-392b-4b9d-8fb3-20c3dfe59894,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd87d00b4-39')
Nov 14 17:59:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Deleting instance files /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c_del
Nov 14 17:59:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Deletion of /opt/stack/data/nova/instances/76193048-410d-4a59-9eb5-165d8ce0af6c_del complete
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:59:02 user nova-compute[76161]: INFO nova.compute.manager [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:59:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.policy [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd463f3fddeba4976bded6ba5abc6c98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952a823fe4e04963916979f78d5c82a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:59:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Creating image(s)
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:59:02 user nova-compute[76161]: INFO nova.compute.claims [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Claim successful on node user
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.205s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.302s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-74889c19-ea7e-4f37-a98f-d8411bb22088 req-849cd5fa-5a4e-47ff-926a-67f9b34b8c25 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Received event network-vif-deleted-d87d00b4-392b-4b9d-8fb3-20c3dfe59894 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:03 user nova-compute[76161]: INFO nova.compute.manager [req-74889c19-ea7e-4f37-a98f-d8411bb22088 req-849cd5fa-5a4e-47ff-926a-67f9b34b8c25 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Neutron deleted interface d87d00b4-392b-4b9d-8fb3-20c3dfe59894; detaching it from the instance and deleting it from the info cache
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.network.neutron [req-74889c19-ea7e-4f37-a98f-d8411bb22088 req-849cd5fa-5a4e-47ff-926a-67f9b34b8c25 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk 1073741824" returned: 0 in 0.086s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.393s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:03 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Took 0.89 seconds to deallocate network for instance.
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-74889c19-ea7e-4f37-a98f-d8411bb22088 req-849cd5fa-5a4e-47ff-926a-67f9b34b8c25 service nova] [instance: 76193048-410d-4a59-9eb5-165d8ce0af6c] Detach interface failed, port_id=d87d00b4-392b-4b9d-8fb3-20c3dfe59894, reason: Instance 76193048-410d-4a59-9eb5-165d8ce0af6c could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Successfully created port: b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.923s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.199s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.network.neutron [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Cannot resize image /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Ensure instance console log exists: /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.policy [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd463f3fddeba4976bded6ba5abc6c98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952a823fe4e04963916979f78d5c82a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:59:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Creating image(s)
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.611s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Successfully updated port: b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.719s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:59:04 user nova-compute[76161]: INFO nova.compute.claims [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Claim successful on node user
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquired lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.202s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:04 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Deleted allocations for instance 76193048-410d-4a59-9eb5-165d8ce0af6c
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-827c2ec0-0109-4a91-8686-f03e98e6781d req-91f2d83b-0ae5-4c44-ab88-f86f3a86c300 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-changed-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-827c2ec0-0109-4a91-8686-f03e98e6781d req-91f2d83b-0ae5-4c44-ab88-f86f3a86c300 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Refreshing instance network info cache due to event network-changed-b4744605-ae45-4625-bdc2-e25dedc542e4. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-827c2ec0-0109-4a91-8686-f03e98e6781d req-91f2d83b-0ae5-4c44-ab88-f86f3a86c300 service nova] Acquiring lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk 1073741824" returned: 0 in 0.085s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Successfully created port: ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9b5bfdf-b3d2-46f6-b075-cd4877da829e tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "76193048-410d-4a59-9eb5-165d8ce0af6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.968s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Cannot resize image /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Ensure instance console log exists: /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updating instance_info_cache with network_info: [{"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Releasing lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Instance network_info: |[{"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-827c2ec0-0109-4a91-8686-f03e98e6781d req-91f2d83b-0ae5-4c44-ab88-f86f3a86c300 service nova] Acquired lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.network.neutron [req-827c2ec0-0109-4a91-8686-f03e98e6781d req-91f2d83b-0ae5-4c44-ab88-f86f3a86c300 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Refreshing network info cache for port b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Start _get_guest_xml network_info=[{"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:59:04 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:04 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-482828575',display_name='tempest-ServerRescueNegativeTestJSON-server-482828575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-482828575',id=30,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-2w3w7gtf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:03Z,user_data=None,user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=b223bed6-d3c6-4841-94e3-73adfb708b8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:18:db,bridge_name='br-int',has_traffic_filtering=True,id=b4744605-ae45-4625-bdc2-e25dedc542e4,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744605-ae') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.objects.instance [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'pci_devices' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:59:04 user nova-compute[76161]:   <uuid>b223bed6-d3c6-4841-94e3-73adfb708b8a</uuid>
Nov 14 17:59:04 user nova-compute[76161]:   <name>instance-0000001e</name>
Nov 14 17:59:04 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:59:04 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:59:04 user nova-compute[76161]:   <metadata>
Nov 14 17:59:04 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:59:04 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:59:04 user nova-compute[76161]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-482828575</nova:name>
Nov 14 17:59:04 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:59:04</nova:creationTime>
Nov 14 17:59:04 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:59:04 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:59:04 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:59:04 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:59:04 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:59:04 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:59:04 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:59:04 user nova-compute[76161]:       <nova:owner>
Nov 14 17:59:04 user nova-compute[76161]:         <nova:user uuid="d463f3fddeba4976bded6ba5abc6c98c">tempest-ServerRescueNegativeTestJSON-1787067728-project-member</nova:user>
Nov 14 17:59:04 user nova-compute[76161]:         <nova:project uuid="952a823fe4e04963916979f78d5c82a7">tempest-ServerRescueNegativeTestJSON-1787067728</nova:project>
Nov 14 17:59:04 user nova-compute[76161]:       </nova:owner>
Nov 14 17:59:04 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:59:04 user nova-compute[76161]:       <nova:ports>
Nov 14 17:59:04 user nova-compute[76161]:         <nova:port uuid="b4744605-ae45-4625-bdc2-e25dedc542e4">
Nov 14 17:59:04 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 17:59:04 user nova-compute[76161]:         </nova:port>
Nov 14 17:59:04 user nova-compute[76161]:       </nova:ports>
Nov 14 17:59:04 user nova-compute[76161]:     </nova:instance>
Nov 14 17:59:04 user nova-compute[76161]:   </metadata>
Nov 14 17:59:04 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:59:04 user nova-compute[76161]:     <system>
Nov 14 17:59:04 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:59:04 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:59:04 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:59:04 user nova-compute[76161]:       <entry name="serial">b223bed6-d3c6-4841-94e3-73adfb708b8a</entry>
Nov 14 17:59:04 user nova-compute[76161]:       <entry name="uuid">b223bed6-d3c6-4841-94e3-73adfb708b8a</entry>
Nov 14 17:59:04 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:59:04 user nova-compute[76161]:     </system>
Nov 14 17:59:04 user nova-compute[76161]:   </sysinfo>
Nov 14 17:59:04 user nova-compute[76161]:   <os>
Nov 14 17:59:04 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:59:04 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:59:04 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:59:04 user nova-compute[76161]:   </os>
Nov 14 17:59:04 user nova-compute[76161]:   <features>
Nov 14 17:59:04 user nova-compute[76161]:     <acpi/>
Nov 14 17:59:04 user nova-compute[76161]:     <apic/>
Nov 14 17:59:04 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:59:04 user nova-compute[76161]:   </features>
Nov 14 17:59:04 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:59:04 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:59:04 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:59:04 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:59:04 user nova-compute[76161]:   </clock>
Nov 14 17:59:04 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:59:04 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:59:04 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:59:04 user nova-compute[76161]:   </cpu>
Nov 14 17:59:04 user nova-compute[76161]:   <devices>
Nov 14 17:59:04 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:59:04 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:59:04 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk"/>
Nov 14 17:59:04 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:59:04 user nova-compute[76161]:     </disk>
Nov 14 17:59:04 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:59:04 user nova-compute[76161]:       <mac address="fa:16:3e:0c:18:db"/>
Nov 14 17:59:04 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:59:04 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:59:04 user nova-compute[76161]:       <target dev="tapb4744605-ae"/>
Nov 14 17:59:04 user nova-compute[76161]:     </interface>
Nov 14 17:59:04 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:59:04 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/console.log" append="off"/>
Nov 14 17:59:04 user nova-compute[76161]:     </serial>
Nov 14 17:59:04 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:59:04 user nova-compute[76161]:     <video>
Nov 14 17:59:04 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:59:04 user nova-compute[76161]:     </video>
Nov 14 17:59:04 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:59:04 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:59:04 user nova-compute[76161]:     </rng>
Nov 14 17:59:04 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:59:04 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:59:04 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:59:04 user nova-compute[76161]:     </memballoon>
Nov 14 17:59:04 user nova-compute[76161]:   </devices>
Nov 14 17:59:04 user nova-compute[76161]: </domain>
Nov 14 17:59:04 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-482828575',display_name='tempest-ServerRescueNegativeTestJSON-server-482828575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-482828575',id=30,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-2w3w7gtf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:03Z,user_data=None,user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=b223bed6-d3c6-4841-94e3-73adfb708b8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:18:db,bridge_name='br-int',has_traffic_filtering=True,id=b4744605-ae45-4625-bdc2-e25dedc542e4,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744605-ae') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG os_vif [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:18:db,bridge_name='br-int',has_traffic_filtering=True,id=b4744605-ae45-4625-bdc2-e25dedc542e4,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744605-ae') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fb3cb69-4aa0-59bd-88db-6d5f7d35bf24', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4744605-ae, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4744605-ae, col_values=(('qos', UUID('b178884a-62d0-4a02-960b-af4ca370f9c1')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4744605-ae, col_values=(('external_ids', {'iface-id': 'b4744605-ae45-4625-bdc2-e25dedc542e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:18:db', 'vm-uuid': 'b223bed6-d3c6-4841-94e3-73adfb708b8a'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:05 user nova-compute[76161]: INFO os_vif [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:18:db,bridge_name='br-int',has_traffic_filtering=True,id=b4744605-ae45-4625-bdc2-e25dedc542e4,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744605-ae')
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No VIF found with MAC fa:16:3e:0c:18:db, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Successfully updated port: ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquired lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:59:05 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.policy [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cee653d6630641b89a074a31d8ddddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e77e9d3740940e6b3c3bbcb66281cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:59:05 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Creating image(s)
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "/opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "/opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "/opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-827c2ec0-0109-4a91-8686-f03e98e6781d req-91f2d83b-0ae5-4c44-ab88-f86f3a86c300 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updated VIF entry in instance network info cache for port b4744605-ae45-4625-bdc2-e25dedc542e4. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-827c2ec0-0109-4a91-8686-f03e98e6781d req-91f2d83b-0ae5-4c44-ab88-f86f3a86c300 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updating instance_info_cache with network_info: [{"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-827c2ec0-0109-4a91-8686-f03e98e6781d req-91f2d83b-0ae5-4c44-ab88-f86f3a86c300 service nova] Releasing lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-bb950112-e94c-44d8-9971-2999c31c6edb req-b2773438-ccf3-461a-bc27-99a2b20dc486 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-changed-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-bb950112-e94c-44d8-9971-2999c31c6edb req-b2773438-ccf3-461a-bc27-99a2b20dc486 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Refreshing instance network info cache due to event network-changed-ec07d878-8c19-4c35-bc46-ba1bf514cf60. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bb950112-e94c-44d8-9971-2999c31c6edb req-b2773438-ccf3-461a-bc27-99a2b20dc486 service nova] Acquiring lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Updating instance_info_cache with network_info: [{"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Releasing lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Instance network_info: |[{"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bb950112-e94c-44d8-9971-2999c31c6edb req-b2773438-ccf3-461a-bc27-99a2b20dc486 service nova] Acquired lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-bb950112-e94c-44d8-9971-2999c31c6edb req-b2773438-ccf3-461a-bc27-99a2b20dc486 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Refreshing network info cache for port ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Start _get_guest_xml network_info=[{"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:59:05 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:05 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296589707',display_name='tempest-ServerRescueNegativeTestJSON-server-296589707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296589707',id=31,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-hz0wi1so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:04Z,user_data=None,user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=de90c284-3d97-42c6-9692-cdac8eccd2ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:17,bridge_name='br-int',has_traffic_filtering=True,id=ec07d878-8c19-4c35-bc46-ba1bf514cf60,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec07d878-8c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.objects.instance [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'pci_devices' on Instance uuid de90c284-3d97-42c6-9692-cdac8eccd2ef {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:59:05 user nova-compute[76161]:   <uuid>de90c284-3d97-42c6-9692-cdac8eccd2ef</uuid>
Nov 14 17:59:05 user nova-compute[76161]:   <name>instance-0000001f</name>
Nov 14 17:59:05 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:59:05 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:59:05 user nova-compute[76161]:   <metadata>
Nov 14 17:59:05 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:59:05 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:59:05 user nova-compute[76161]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-296589707</nova:name>
Nov 14 17:59:05 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:59:05</nova:creationTime>
Nov 14 17:59:05 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:59:05 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:59:05 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:59:05 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:59:05 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:59:05 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:59:05 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:59:05 user nova-compute[76161]:       <nova:owner>
Nov 14 17:59:05 user nova-compute[76161]:         <nova:user uuid="d463f3fddeba4976bded6ba5abc6c98c">tempest-ServerRescueNegativeTestJSON-1787067728-project-member</nova:user>
Nov 14 17:59:05 user nova-compute[76161]:         <nova:project uuid="952a823fe4e04963916979f78d5c82a7">tempest-ServerRescueNegativeTestJSON-1787067728</nova:project>
Nov 14 17:59:05 user nova-compute[76161]:       </nova:owner>
Nov 14 17:59:05 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:59:05 user nova-compute[76161]:       <nova:ports>
Nov 14 17:59:05 user nova-compute[76161]:         <nova:port uuid="ec07d878-8c19-4c35-bc46-ba1bf514cf60">
Nov 14 17:59:05 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 17:59:05 user nova-compute[76161]:         </nova:port>
Nov 14 17:59:05 user nova-compute[76161]:       </nova:ports>
Nov 14 17:59:05 user nova-compute[76161]:     </nova:instance>
Nov 14 17:59:05 user nova-compute[76161]:   </metadata>
Nov 14 17:59:05 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:59:05 user nova-compute[76161]:     <system>
Nov 14 17:59:05 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:59:05 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:59:05 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:59:05 user nova-compute[76161]:       <entry name="serial">de90c284-3d97-42c6-9692-cdac8eccd2ef</entry>
Nov 14 17:59:05 user nova-compute[76161]:       <entry name="uuid">de90c284-3d97-42c6-9692-cdac8eccd2ef</entry>
Nov 14 17:59:05 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:59:05 user nova-compute[76161]:     </system>
Nov 14 17:59:05 user nova-compute[76161]:   </sysinfo>
Nov 14 17:59:05 user nova-compute[76161]:   <os>
Nov 14 17:59:05 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:59:05 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:59:05 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:59:05 user nova-compute[76161]:   </os>
Nov 14 17:59:05 user nova-compute[76161]:   <features>
Nov 14 17:59:05 user nova-compute[76161]:     <acpi/>
Nov 14 17:59:05 user nova-compute[76161]:     <apic/>
Nov 14 17:59:05 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:59:05 user nova-compute[76161]:   </features>
Nov 14 17:59:05 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:59:05 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:59:05 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:59:05 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:59:05 user nova-compute[76161]:   </clock>
Nov 14 17:59:05 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:59:05 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:59:05 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:59:05 user nova-compute[76161]:   </cpu>
Nov 14 17:59:05 user nova-compute[76161]:   <devices>
Nov 14 17:59:05 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:59:05 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:59:05 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk"/>
Nov 14 17:59:05 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:59:05 user nova-compute[76161]:     </disk>
Nov 14 17:59:05 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:59:05 user nova-compute[76161]:       <mac address="fa:16:3e:9c:eb:17"/>
Nov 14 17:59:05 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:59:05 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:59:05 user nova-compute[76161]:       <target dev="tapec07d878-8c"/>
Nov 14 17:59:05 user nova-compute[76161]:     </interface>
Nov 14 17:59:05 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:59:05 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/console.log" append="off"/>
Nov 14 17:59:05 user nova-compute[76161]:     </serial>
Nov 14 17:59:05 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:59:05 user nova-compute[76161]:     <video>
Nov 14 17:59:05 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:59:05 user nova-compute[76161]:     </video>
Nov 14 17:59:05 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:59:05 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:59:05 user nova-compute[76161]:     </rng>
Nov 14 17:59:05 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:59:05 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:59:05 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:59:05 user nova-compute[76161]:     </memballoon>
Nov 14 17:59:05 user nova-compute[76161]:   </devices>
Nov 14 17:59:05 user nova-compute[76161]: </domain>
Nov 14 17:59:05 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296589707',display_name='tempest-ServerRescueNegativeTestJSON-server-296589707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296589707',id=31,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-hz0wi1so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:04Z,user_data=None,user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=de90c284-3d97-42c6-9692-cdac8eccd2ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:17,bridge_name='br-int',has_traffic_filtering=True,id=ec07d878-8c19-4c35-bc46-ba1bf514cf60,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec07d878-8c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG os_vif [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:17,bridge_name='br-int',has_traffic_filtering=True,id=ec07d878-8c19-4c35-bc46-ba1bf514cf60,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec07d878-8c') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd19cc872-f86e-5cf8-9d90-16c3eb1e20f9', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk 1073741824" returned: 0 in 0.048s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec07d878-8c, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec07d878-8c, col_values=(('qos', UUID('335801f0-d085-4d17-b1dc-40fe51d0a994')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec07d878-8c, col_values=(('external_ids', {'iface-id': 'ec07d878-8c19-4c35-bc46-ba1bf514cf60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:eb:17', 'vm-uuid': 'de90c284-3d97-42c6-9692-cdac8eccd2ef'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Successfully created port: 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:05 user nova-compute[76161]: INFO os_vif [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:17,bridge_name='br-int',has_traffic_filtering=True,id=ec07d878-8c19-4c35-bc46-ba1bf514cf60,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec07d878-8c')
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No VIF found with MAC fa:16:3e:9c:eb:17, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:59:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Cannot resize image /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Ensure instance console log exists: /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG nova.network.neutron [req-bb950112-e94c-44d8-9971-2999c31c6edb req-b2773438-ccf3-461a-bc27-99a2b20dc486 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Updated VIF entry in instance network info cache for port ec07d878-8c19-4c35-bc46-ba1bf514cf60. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG nova.network.neutron [req-bb950112-e94c-44d8-9971-2999c31c6edb req-b2773438-ccf3-461a-bc27-99a2b20dc486 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Updating instance_info_cache with network_info: [{"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bb950112-e94c-44d8-9971-2999c31c6edb req-b2773438-ccf3-461a-bc27-99a2b20dc486 service nova] Releasing lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQzrRHBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:06 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:59:06 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:59:06 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8167b3b-9c07-4f1d-8922-914628802210]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:59:06 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aba526-3a95-4f9f-8e25-295776981219]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8] added
Nov 14 17:59:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b665a61a-c075-4588-8b22-52e2e795644f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd6c147-e6fa-429f-bdf8-c5a2a2e99b5e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQzrRHBt {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQzrRHBt" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ebf2d3-316d-49b5-b8c8-7a5078d11e0e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KQzrRHBt'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[970c6733-8347-4632-8661-fa50f91e09f9]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3db8143-f97e-45a2-8bf5-adea443a3677]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:06 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:06 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6314e3d8-6893-441a-bb26-8a189eb19837]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260]
Nov 14 17:59:06 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260] successful.
Nov 14 17:59:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a2c055-800d-456a-87ba-8cb8716c7b1c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3a3ebe-4984-45a4-a8db-b48c8372b7ed]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:06 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:06 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:06 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:06 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a5cafd-4fd6-4450-b0fd-8735fcbd242c]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Successfully updated port: 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquired lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-209b0e42-1ecf-4670-825f-7c592219ef0b req-6c254790-bb05-4edf-a98f-a8fbaf3e0b4c service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-209b0e42-1ecf-4670-825f-7c592219ef0b req-6c254790-bb05-4edf-a98f-a8fbaf3e0b4c service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-209b0e42-1ecf-4670-825f-7c592219ef0b req-6c254790-bb05-4edf-a98f-a8fbaf3e0b4c service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-209b0e42-1ecf-4670-825f-7c592219ef0b req-6c254790-bb05-4edf-a98f-a8fbaf3e0b4c service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-209b0e42-1ecf-4670-825f-7c592219ef0b req-6c254790-bb05-4edf-a98f-a8fbaf3e0b4c service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:07 user nova-compute[76161]: WARNING nova.compute.manager [req-209b0e42-1ecf-4670-825f-7c592219ef0b req-6c254790-bb05-4edf-a98f-a8fbaf3e0b4c service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state building and task_state spawning.
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updating instance_info_cache with network_info: [{"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Releasing lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Instance network_info: |[{"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Start _get_guest_xml network_info=[{"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:59:07 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:07 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1148321708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1148321708',id=32,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWDC5huzIpKEHV7/Vtzw1d40g9OR0Xm02D0MURyQiuMKFJcZ6JPA6YiqIW1t7K6sD6LZw3Pp8mE2Ox2eP8kBTzl19n94U5ATtytTpddmzWU30WOCt5Vh7+HiX5AzmSg3g==',key_name='tempest-keypair-926458659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-fw12nx7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=72ea8ec0-29d3-49f1-bd61-7047aabfbaff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'pci_devices' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:59:07 user nova-compute[76161]:   <uuid>72ea8ec0-29d3-49f1-bd61-7047aabfbaff</uuid>
Nov 14 17:59:07 user nova-compute[76161]:   <name>instance-00000020</name>
Nov 14 17:59:07 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:59:07 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:59:07 user nova-compute[76161]:   <metadata>
Nov 14 17:59:07 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:59:07 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:59:07 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1148321708</nova:name>
Nov 14 17:59:07 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:59:07</nova:creationTime>
Nov 14 17:59:07 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:59:07 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:59:07 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:59:07 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:59:07 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:59:07 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:59:07 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:59:07 user nova-compute[76161]:       <nova:owner>
Nov 14 17:59:07 user nova-compute[76161]:         <nova:user uuid="cee653d6630641b89a074a31d8ddddbc">tempest-AttachVolumeShelveTestJSON-1624203066-project-member</nova:user>
Nov 14 17:59:07 user nova-compute[76161]:         <nova:project uuid="3e77e9d3740940e6b3c3bbcb66281cdd">tempest-AttachVolumeShelveTestJSON-1624203066</nova:project>
Nov 14 17:59:07 user nova-compute[76161]:       </nova:owner>
Nov 14 17:59:07 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:59:07 user nova-compute[76161]:       <nova:ports>
Nov 14 17:59:07 user nova-compute[76161]:         <nova:port uuid="61e4ef5f-6fe5-430d-aeb6-af8dfa723f53">
Nov 14 17:59:07 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 17:59:07 user nova-compute[76161]:         </nova:port>
Nov 14 17:59:07 user nova-compute[76161]:       </nova:ports>
Nov 14 17:59:07 user nova-compute[76161]:     </nova:instance>
Nov 14 17:59:07 user nova-compute[76161]:   </metadata>
Nov 14 17:59:07 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:59:07 user nova-compute[76161]:     <system>
Nov 14 17:59:07 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:59:07 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:59:07 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:59:07 user nova-compute[76161]:       <entry name="serial">72ea8ec0-29d3-49f1-bd61-7047aabfbaff</entry>
Nov 14 17:59:07 user nova-compute[76161]:       <entry name="uuid">72ea8ec0-29d3-49f1-bd61-7047aabfbaff</entry>
Nov 14 17:59:07 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:59:07 user nova-compute[76161]:     </system>
Nov 14 17:59:07 user nova-compute[76161]:   </sysinfo>
Nov 14 17:59:07 user nova-compute[76161]:   <os>
Nov 14 17:59:07 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:59:07 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:59:07 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:59:07 user nova-compute[76161]:   </os>
Nov 14 17:59:07 user nova-compute[76161]:   <features>
Nov 14 17:59:07 user nova-compute[76161]:     <acpi/>
Nov 14 17:59:07 user nova-compute[76161]:     <apic/>
Nov 14 17:59:07 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:59:07 user nova-compute[76161]:   </features>
Nov 14 17:59:07 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:59:07 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:59:07 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:59:07 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:59:07 user nova-compute[76161]:   </clock>
Nov 14 17:59:07 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:59:07 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:59:07 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:59:07 user nova-compute[76161]:   </cpu>
Nov 14 17:59:07 user nova-compute[76161]:   <devices>
Nov 14 17:59:07 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:59:07 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:59:07 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk"/>
Nov 14 17:59:07 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:59:07 user nova-compute[76161]:     </disk>
Nov 14 17:59:07 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:59:07 user nova-compute[76161]:       <mac address="fa:16:3e:b2:ce:91"/>
Nov 14 17:59:07 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:59:07 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:59:07 user nova-compute[76161]:       <target dev="tap61e4ef5f-6f"/>
Nov 14 17:59:07 user nova-compute[76161]:     </interface>
Nov 14 17:59:07 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:59:07 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/console.log" append="off"/>
Nov 14 17:59:07 user nova-compute[76161]:     </serial>
Nov 14 17:59:07 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:59:07 user nova-compute[76161]:     <video>
Nov 14 17:59:07 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:59:07 user nova-compute[76161]:     </video>
Nov 14 17:59:07 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:59:07 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:59:07 user nova-compute[76161]:     </rng>
Nov 14 17:59:07 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:59:07 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:59:07 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:59:07 user nova-compute[76161]:     </memballoon>
Nov 14 17:59:07 user nova-compute[76161]:   </devices>
Nov 14 17:59:07 user nova-compute[76161]: </domain>
Nov 14 17:59:07 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1148321708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1148321708',id=32,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWDC5huzIpKEHV7/Vtzw1d40g9OR0Xm02D0MURyQiuMKFJcZ6JPA6YiqIW1t7K6sD6LZw3Pp8mE2Ox2eP8kBTzl19n94U5ATtytTpddmzWU30WOCt5Vh7+HiX5AzmSg3g==',key_name='tempest-keypair-926458659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-fw12nx7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=72ea8ec0-29d3-49f1-bd61-7047aabfbaff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG os_vif [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6070822-d064-527e-bda5-3c83301218c2', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61e4ef5f-6f, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61e4ef5f-6f, col_values=(('qos', UUID('89daa2b0-89ba-412d-b394-afa220cf1a0e')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61e4ef5f-6f, col_values=(('external_ids', {'iface-id': '61e4ef5f-6fe5-430d-aeb6-af8dfa723f53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ce:91', 'vm-uuid': '72ea8ec0-29d3-49f1-bd61-7047aabfbaff'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: INFO os_vif [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f')
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] No VIF found with MAC fa:16:3e:b2:ce:91, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-77823437-0516-4558-8909-fa075479f6b4 req-7c4bfbe9-bc1e-421a-a33c-0f74762d67cc service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-changed-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-77823437-0516-4558-8909-fa075479f6b4 req-7c4bfbe9-bc1e-421a-a33c-0f74762d67cc service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Refreshing instance network info cache due to event network-changed-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-77823437-0516-4558-8909-fa075479f6b4 req-7c4bfbe9-bc1e-421a-a33c-0f74762d67cc service nova] Acquiring lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-77823437-0516-4558-8909-fa075479f6b4 req-7c4bfbe9-bc1e-421a-a33c-0f74762d67cc service nova] Acquired lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.network.neutron [req-77823437-0516-4558-8909-fa075479f6b4 req-7c4bfbe9-bc1e-421a-a33c-0f74762d67cc service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Refreshing network info cache for port 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQzrRHBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23662313330636334', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662313330636334', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:59:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:59:08 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:59:08 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 17:59:08 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:59:08 user nova-compute[76161]:   <serial>b0aadcea-0bc4-46b4-b4a5-77abc43079a8</serial>
Nov 14 17:59:08 user nova-compute[76161]: </disk>
Nov 14 17:59:08 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:59:08 user nova-compute[76161]: DEBUG nova.network.neutron [req-77823437-0516-4558-8909-fa075479f6b4 req-7c4bfbe9-bc1e-421a-a33c-0f74762d67cc service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updated VIF entry in instance network info cache for port 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:59:08 user nova-compute[76161]: DEBUG nova.network.neutron [req-77823437-0516-4558-8909-fa075479f6b4 req-7c4bfbe9-bc1e-421a-a33c-0f74762d67cc service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updating instance_info_cache with network_info: [{"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-77823437-0516-4558-8909-fa075479f6b4 req-7c4bfbe9-bc1e-421a-a33c-0f74762d67cc service nova] Releasing lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-5c253d32-c6ae-48be-8eda-95c74201ec4e req-818321e2-2d60-4569-adad-8eaa211560de service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5c253d32-c6ae-48be-8eda-95c74201ec4e req-818321e2-2d60-4569-adad-8eaa211560de service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5c253d32-c6ae-48be-8eda-95c74201ec4e req-818321e2-2d60-4569-adad-8eaa211560de service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5c253d32-c6ae-48be-8eda-95c74201ec4e req-818321e2-2d60-4569-adad-8eaa211560de service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-5c253d32-c6ae-48be-8eda-95c74201ec4e req-818321e2-2d60-4569-adad-8eaa211560de service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:09 user nova-compute[76161]: WARNING nova.compute.manager [req-5c253d32-c6ae-48be-8eda-95c74201ec4e req-818321e2-2d60-4569-adad-8eaa211560de service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state building and task_state spawning.
Nov 14 17:59:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:09 user nova-compute[76161]: WARNING nova.compute.manager [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state building and task_state spawning.
Nov 14 17:59:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:09 user nova-compute[76161]: WARNING nova.compute.manager [req-217f01e5-02ea-4dd8-ab3a-13e1cd00bbad req-3e507a32-2c8b-4f25-bb8a-ef8664842a50 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state building and task_state spawning.
Nov 14 17:59:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No VIF found with MAC fa:16:3e:38:ed:cd, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fda7504-3004-4181-952b-16c52eb64e0d tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.005s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-318869b2-35d6-4f6d-85fb-fd01c7e112cc req-ed7805d1-42af-48f4-b249-b27af5b1e332 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-318869b2-35d6-4f6d-85fb-fd01c7e112cc req-ed7805d1-42af-48f4-b249-b27af5b1e332 service nova] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-318869b2-35d6-4f6d-85fb-fd01c7e112cc req-ed7805d1-42af-48f4-b249-b27af5b1e332 service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-318869b2-35d6-4f6d-85fb-fd01c7e112cc req-ed7805d1-42af-48f4-b249-b27af5b1e332 service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-318869b2-35d6-4f6d-85fb-fd01c7e112cc req-ed7805d1-42af-48f4-b249-b27af5b1e332 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] No waiting events found dispatching network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:10 user nova-compute[76161]: WARNING nova.compute.manager [req-318869b2-35d6-4f6d-85fb-fd01c7e112cc req-ed7805d1-42af-48f4-b249-b27af5b1e332 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received unexpected event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 for instance with vm_state building and task_state spawning.
Nov 14 17:59:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99b08fa7-0946-4057-8276-c96701a7a8e2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99b08fa7-0946-4057-8276-c96701a7a8e2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-99b08fa7-0946-4057-8276-c96701a7a8e2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-99b08fa7-0946-4057-8276-c96701a7a8e2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76161) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG nova.objects.instance [None req-99b08fa7-0946-4057-8276-c96701a7a8e2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:59:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Instance spawned successfully.
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance destroyed successfully.
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.compute.manager [None req-99b08fa7-0946-4057-8276-c96701a7a8e2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:59:11 user nova-compute[76161]: INFO nova.compute.manager [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Took 8.91 seconds to spawn the instance on the hypervisor.
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99b08fa7-0946-4057-8276-c96701a7a8e2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.916s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:11 user nova-compute[76161]: WARNING nova.compute.manager [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state stopped and task_state None.
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:11 user nova-compute[76161]: WARNING nova.compute.manager [req-147661c9-b033-44ad-8739-81597137d637 req-a1e66025-e822-4648-bb6d-ea2a14a18d72 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state stopped and task_state None.
Nov 14 17:59:11 user nova-compute[76161]: INFO nova.compute.manager [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Took 9.83 seconds to build instance.
Nov 14 17:59:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9c772431-2300-472d-8169-f46d79d56c69 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.964s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-9d85d911-4a64-4d40-b259-9ee58328b2eb req-7b011264-10d5-4e42-922f-42991c715608 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9d85d911-4a64-4d40-b259-9ee58328b2eb req-7b011264-10d5-4e42-922f-42991c715608 service nova] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9d85d911-4a64-4d40-b259-9ee58328b2eb req-7b011264-10d5-4e42-922f-42991c715608 service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9d85d911-4a64-4d40-b259-9ee58328b2eb req-7b011264-10d5-4e42-922f-42991c715608 service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-9d85d911-4a64-4d40-b259-9ee58328b2eb req-7b011264-10d5-4e42-922f-42991c715608 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] No waiting events found dispatching network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:12 user nova-compute[76161]: WARNING nova.compute.manager [req-9d85d911-4a64-4d40-b259-9ee58328b2eb req-7b011264-10d5-4e42-922f-42991c715608 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received unexpected event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 for instance with vm_state building and task_state spawning.
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:59:12 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Instance spawned successfully.
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:59:12 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Instance spawned successfully.
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:12 user nova-compute[76161]: INFO nova.compute.manager [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Took 7.20 seconds to spawn the instance on the hypervisor.
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:59:12 user nova-compute[76161]: INFO nova.compute.manager [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Took 8.70 seconds to spawn the instance on the hypervisor.
Nov 14 17:59:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:59:12 user nova-compute[76161]: INFO nova.compute.manager [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Took 9.13 seconds to build instance.
Nov 14 17:59:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9703e818-68cd-46c7-90f0-e667b8c5ce3b tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.335s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:12 user nova-compute[76161]: INFO nova.compute.manager [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Took 9.99 seconds to build instance.
Nov 14 17:59:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-366a25f1-87b3-42e9-880d-8a3063fcdb73 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.088s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-fede1831-6c00-468b-a5cb-775227d826fd req-0e3bc172-ea18-4d95-8585-0eded7cd1110 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received event network-changed-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-fede1831-6c00-468b-a5cb-775227d826fd req-0e3bc172-ea18-4d95-8585-0eded7cd1110 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Refreshing instance network info cache due to event network-changed-ec00dfa7-65ad-414a-9001-06902e33b728. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:59:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fede1831-6c00-468b-a5cb-775227d826fd req-0e3bc172-ea18-4d95-8585-0eded7cd1110 service nova] Acquiring lock "refresh_cache-8a5c3b81-d4e1-416f-9512-592fe67cae44" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fede1831-6c00-468b-a5cb-775227d826fd req-0e3bc172-ea18-4d95-8585-0eded7cd1110 service nova] Acquired lock "refresh_cache-8a5c3b81-d4e1-416f-9512-592fe67cae44" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-fede1831-6c00-468b-a5cb-775227d826fd req-0e3bc172-ea18-4d95-8585-0eded7cd1110 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Refreshing network info cache for port ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:59:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-fede1831-6c00-468b-a5cb-775227d826fd req-0e3bc172-ea18-4d95-8585-0eded7cd1110 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Updated VIF entry in instance network info cache for port ec00dfa7-65ad-414a-9001-06902e33b728. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:59:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-fede1831-6c00-468b-a5cb-775227d826fd req-0e3bc172-ea18-4d95-8585-0eded7cd1110 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Updating instance_info_cache with network_info: [{"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fede1831-6c00-468b-a5cb-775227d826fd req-0e3bc172-ea18-4d95-8585-0eded7cd1110 service nova] Releasing lock "refresh_cache-8a5c3b81-d4e1-416f-9512-592fe67cae44" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updating instance_info_cache with network_info: [{"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:59:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:18 user nova-compute[76161]: INFO nova.compute.manager [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attaching volume 1daecbb1-4b96-4cbc-a966-540c410d44a9 to /dev/vdb
Nov 14 17:59:18 user nova-compute[76161]: DEBUG os_brick.utils [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[703beb3d-12c3-4974-bd34-76e1746f1fed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b0bda2-bd3f-40b0-89dd-d45aa7b36a08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2ac37a-d35e-4384-b9df-0ffde224491d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac4bd17-2cec-4586-a9a5-441ddf9389c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:59:18 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:59:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b7ddb6-1ad7-4ffa-8ebf-60fb041a6804]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG os_brick.utils [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:18 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Updating existing volume attachment record: 0e96025b-d1ac-42db-be49-d938516cdbf6 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGuvIlae', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:23 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:59:23 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:59:23 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[940543c8-c61b-4b83-a79b-8d47e9fe65d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:59:23 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0716c96a-a26a-4aef-b6b0-f3d1c0991722]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9] added
Nov 14 17:59:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[098b77ff-3418-433b-86b9-927788e3ae0a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a498de-8d9f-44cd-9fe9-eb7fc092e817]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGuvIlae {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGuvIlae" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97f8d1d-b7e6-44c4-853b-26a018b52a50]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qGuvIlae'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba5bae-fb39-4e23-b27d-8e67a52eb104]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[14423993-e8c5-4832-bf9b-9511e60e4d76]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:24 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:24 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:24 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:24 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916c9ff-8592-4714-a5f0-e29a7bbab240]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9, portal: 172.16.0.220,3260]
Nov 14 17:59:24 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9, portal: 172.16.0.220,3260] successful.
Nov 14 17:59:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6079e1e-0579-4715-8b8d-bb1374f138d2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[293d981b-2086-4c44-aab8-463fc6a16c38]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:24 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:24 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:24 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:24 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:24 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:24 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be161fd-309c-4ebd-8988-7459dc22285b]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGuvIlae', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:59:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23833353733376166', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833353733376166', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:59:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:25 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 17:59:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:59:25 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:59:25 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 17:59:25 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:59:25 user nova-compute[76161]:   <serial>1daecbb1-4b96-4cbc-a966-540c410d44a9</serial>
Nov 14 17:59:25 user nova-compute[76161]: </disk>
Nov 14 17:59:25 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:59:26 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:26 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7255MB free_disk=25.148109436035156GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No VIF found with MAC fa:16:3e:24:51:b7, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 75295499-8f99-4c9b-a556-c1287c61d8f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 952593b7-cc8b-4d50-8aa8-a50e385e088b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance c6f53da9-e029-4aa7-8dad-edd41eb2eb5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 385ef873-fc1f-46ae-90da-b75f82524b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a2689a09-608c-42ff-b47c-b2977b186108 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.959s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:59:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.751s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-cdc32d91-645b-412f-9770-9213555aa0fc req-e85ae506-8a4d-4675-bdcc-27bf88d52a04 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received event network-changed-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-cdc32d91-645b-412f-9770-9213555aa0fc req-e85ae506-8a4d-4675-bdcc-27bf88d52a04 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Refreshing instance network info cache due to event network-changed-acaa3207-c1d5-4d0a-ad74-de7cb45ab810. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:59:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cdc32d91-645b-412f-9770-9213555aa0fc req-e85ae506-8a4d-4675-bdcc-27bf88d52a04 service nova] Acquiring lock "refresh_cache-952593b7-cc8b-4d50-8aa8-a50e385e088b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cdc32d91-645b-412f-9770-9213555aa0fc req-e85ae506-8a4d-4675-bdcc-27bf88d52a04 service nova] Acquired lock "refresh_cache-952593b7-cc8b-4d50-8aa8-a50e385e088b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:29 user nova-compute[76161]: DEBUG nova.network.neutron [req-cdc32d91-645b-412f-9770-9213555aa0fc req-e85ae506-8a4d-4675-bdcc-27bf88d52a04 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Refreshing network info cache for port acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:59:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:30 user nova-compute[76161]: DEBUG nova.network.neutron [req-cdc32d91-645b-412f-9770-9213555aa0fc req-e85ae506-8a4d-4675-bdcc-27bf88d52a04 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Updated VIF entry in instance network info cache for port acaa3207-c1d5-4d0a-ad74-de7cb45ab810. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:59:30 user nova-compute[76161]: DEBUG nova.network.neutron [req-cdc32d91-645b-412f-9770-9213555aa0fc req-e85ae506-8a4d-4675-bdcc-27bf88d52a04 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Updating instance_info_cache with network_info: [{"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cdc32d91-645b-412f-9770-9213555aa0fc req-e85ae506-8a4d-4675-bdcc-27bf88d52a04 service nova] Releasing lock "refresh_cache-952593b7-cc8b-4d50-8aa8-a50e385e088b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:30 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lazy-loading 'flavor' on Instance uuid 952593b7-cc8b-4d50-8aa8-a50e385e088b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:31 user nova-compute[76161]: INFO nova.compute.manager [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Attaching volume e4e1e673-3aed-4b88-9155-67bfe8f54752 to /dev/vdb
Nov 14 17:59:31 user nova-compute[76161]: DEBUG os_brick.utils [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[725de4d1-0386-4c8f-aae7-83e25a6a1904]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a243d6-e1f6-4b1c-a490-bfc5d59ac4c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[41526e4a-9083-45a2-88ea-c8403e3534f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[323951ac-1a75-4882-87ca-f73c895f75a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:59:31 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:59:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[68417e81-5b15-44fd-87cb-e7e3d51a6496]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG os_brick.utils [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:31 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Updating existing volume attachment record: 76548a45-9571-4d3b-b26a-cf783df53150 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:59:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:34 user nova-compute[76161]: INFO nova.compute.manager [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Detaching volume 1daecbb1-4b96-4cbc-a966-540c410d44a9
Nov 14 17:59:34 user nova-compute[76161]: INFO nova.virt.block_device [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attempting to driver detach volume 1daecbb1-4b96-4cbc-a966-540c410d44a9 from mountpoint /dev/vdb
Nov 14 17:59:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Attempting to detach device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:59:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:59:34 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:59:34 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 17:59:34 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:59:34 user nova-compute[76161]:   <serial>1daecbb1-4b96-4cbc-a966-540c410d44a9</serial>
Nov 14 17:59:34 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:59:34 user nova-compute[76161]: </disk>
Nov 14 17:59:34 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:59:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Successfully detached device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the persistent domain config.
Nov 14 17:59:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:59:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:59:34 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:59:34 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 17:59:34 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:59:34 user nova-compute[76161]:   <serial>1daecbb1-4b96-4cbc-a966-540c410d44a9</serial>
Nov 14 17:59:34 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:59:34 user nova-compute[76161]: </disk>
Nov 14 17:59:34 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:59:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTuielRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:35 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:59:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:59:35 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:59:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:59:35 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:59:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbf74e6-4ad8-4119-8f56-442d43725702]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:59:35 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[229e651b-0930-4617-9786-0bc6ff46d578]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752] added
Nov 14 17:59:35 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[16152e0d-12ec-4b9f-8a51-dd1d154c9ff3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a205aa-af8d-4886-8fda-a2ebf17c45a7]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTuielRr {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTuielRr" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e79291-95b2-4c0f-bfae-83e87ff679c8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WTuielRr'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8882344-f03f-4249-9619-6bb2ef056f9b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[594b4d0e-5f02-4728-9e87-0e1023685c92]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:36 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:36 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f3696-789d-4564-8e1e-91a6e3133b86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752, portal: 172.16.0.220,3260]
Nov 14 17:59:36 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752, portal: 172.16.0.220,3260] successful.
Nov 14 17:59:36 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[889d0c33-009d-490e-ad1a-0abdd0d77cda]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4ce309-ea55-4e3c-9cc4-cb0f3f39cb87]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 17:59:36 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:36 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 17:59:36 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aaca0a-00e4-4584-b57f-067c06f71401]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "f8df16e2-c87f-432e-a639-f4d4931d9902" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:59:37 user nova-compute[76161]: INFO nova.compute.claims [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Claim successful on node user
Nov 14 17:59:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTuielRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26336663961653836', 'path': '/dev/sde'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336663961653836', 'path': '/dev/sde'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lazy-loading 'flavor' on Instance uuid 952593b7-cc8b-4d50-8aa8-a50e385e088b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:59:37 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:59:37 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 17:59:37 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:59:37 user nova-compute[76161]:   <serial>e4e1e673-3aed-4b88-9155-67bfe8f54752</serial>
Nov 14 17:59:37 user nova-compute[76161]: </disk>
Nov 14 17:59:37 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-f5a0310f-30f5-4210-b61f-f4863137f9eb req-e0509da8-8ff6-49c7-8ee0-83dbbd5a6bfd service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-changed-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-f5a0310f-30f5-4210-b61f-f4863137f9eb req-e0509da8-8ff6-49c7-8ee0-83dbbd5a6bfd service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Refreshing instance network info cache due to event network-changed-17a4e939-dd34-4c8e-b254-079202ca1814. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f5a0310f-30f5-4210-b61f-f4863137f9eb req-e0509da8-8ff6-49c7-8ee0-83dbbd5a6bfd service nova] Acquiring lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f5a0310f-30f5-4210-b61f-f4863137f9eb req-e0509da8-8ff6-49c7-8ee0-83dbbd5a6bfd service nova] Acquired lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.network.neutron [req-f5a0310f-30f5-4210-b61f-f4863137f9eb req-e0509da8-8ff6-49c7-8ee0-83dbbd5a6bfd service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Refreshing network info cache for port 17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.659s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.network.neutron [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:59:37 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:59:37 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Creating image(s)
Nov 14 17:59:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "/opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "/opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] No VIF found with MAC fa:16:3e:29:91:d7, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.network.neutron [req-f5a0310f-30f5-4210-b61f-f4863137f9eb req-e0509da8-8ff6-49c7-8ee0-83dbbd5a6bfd service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updated VIF entry in instance network info cache for port 17a4e939-dd34-4c8e-b254-079202ca1814. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.network.neutron [req-f5a0310f-30f5-4210-b61f-f4863137f9eb req-e0509da8-8ff6-49c7-8ee0-83dbbd5a6bfd service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating instance_info_cache with network_info: [{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f5a0310f-30f5-4210-b61f-f4863137f9eb req-e0509da8-8ff6-49c7-8ee0-83dbbd5a6bfd service nova] Releasing lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.201s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.policy [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cbac0f2bd224fc88b8b1bbb332fd793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92344de47ffa4a5883115469db09b283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c85e337d-36fd-45db-b18f-d6d2edc93a86 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.133s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:38 user nova-compute[76161]: INFO nova.compute.manager [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Shelve offloading
Nov 14 17:59:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.229s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk 1073741824" returned: 0 in 0.059s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Cannot resize image /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Ensure instance console log exists: /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:38 user nova-compute[76161]: DEBUG nova.network.neutron [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Successfully created port: ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:59:39 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Instance destroyed successfully.
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.compute.manager [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquired lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.network.neutron [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-e83fcd0a-7813-4dc4-bcd8-e66c8a389c8b req-76afa60d-e6bc-490f-9ff3-fd7876845e07 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-vif-unplugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e83fcd0a-7813-4dc4-bcd8-e66c8a389c8b req-76afa60d-e6bc-490f-9ff3-fd7876845e07 service nova] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e83fcd0a-7813-4dc4-bcd8-e66c8a389c8b req-76afa60d-e6bc-490f-9ff3-fd7876845e07 service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e83fcd0a-7813-4dc4-bcd8-e66c8a389c8b req-76afa60d-e6bc-490f-9ff3-fd7876845e07 service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-e83fcd0a-7813-4dc4-bcd8-e66c8a389c8b req-76afa60d-e6bc-490f-9ff3-fd7876845e07 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] No waiting events found dispatching network-vif-unplugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:39 user nova-compute[76161]: WARNING nova.compute.manager [req-e83fcd0a-7813-4dc4-bcd8-e66c8a389c8b req-76afa60d-e6bc-490f-9ff3-fd7876845e07 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received unexpected event network-vif-unplugged-17a4e939-dd34-4c8e-b254-079202ca1814 for instance with vm_state active and task_state shelving.
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.network.neutron [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating instance_info_cache with network_info: [{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Releasing lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.network.neutron [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Successfully updated port: ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "refresh_cache-f8df16e2-c87f-432e-a639-f4d4931d9902" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquired lock "refresh_cache-f8df16e2-c87f-432e-a639-f4d4931d9902" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.network.neutron [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-98960891-e280-4353-95e4-572aa8bbf33b req-998e09bd-ab97-4d51-9f71-4b34f19997d2 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received event network-changed-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-98960891-e280-4353-95e4-572aa8bbf33b req-998e09bd-ab97-4d51-9f71-4b34f19997d2 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Refreshing instance network info cache due to event network-changed-ac8b1015-35a1-4861-ada7-d67db570f0c2. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-98960891-e280-4353-95e4-572aa8bbf33b req-998e09bd-ab97-4d51-9f71-4b34f19997d2 service nova] Acquiring lock "refresh_cache-f8df16e2-c87f-432e-a639-f4d4931d9902" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.network.neutron [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:59:39 user nova-compute[76161]: INFO nova.compute.manager [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] instance snapshotting
Nov 14 17:59:39 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Beginning live snapshot process
Nov 14 17:59:39 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Instance destroyed successfully.
Nov 14 17:59:39 user nova-compute[76161]: DEBUG nova.objects.instance [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lazy-loading 'resources' on Instance uuid c6f53da9-e029-4aa7-8dad-edd41eb2eb5d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-971044589',display_name='tempest-TestShelveInstance-server-971044589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-971044589',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACZLnDoDR2XNy/4jmfnxkmNhDJA1P9Br59clEYGiQHmDpGAVt5kNhXg5880Zep/dKONHa3tuwi8zStSfZ3O5TInSOxnWMhNTx/hE1EfctdbeJS8CuZ6VujHjO3E2quKbQ==',key_name='tempest-TestShelveInstance-2116969338',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39dc84f83d834a618106830659fee331',ramdisk_id='',reservation_id='r-05v9kppj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1328804028',owner_user_name='tempest-TestShelveInstance-1328804028-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:57:58Z,user_data=None,user_id='5b6eb8d881b84217b0e138def245cab0',uuid=c6f53da9-e029-4aa7-8dad-edd41eb2eb5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converting VIF {"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_vif [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17a4e939-dd, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Updating instance_info_cache with network_info: [{"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38478b1d-c958-4aa5-a7d4-32d5436d6644) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Releasing lock "refresh_cache-f8df16e2-c87f-432e-a639-f4d4931d9902" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Instance network_info: |[{"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-98960891-e280-4353-95e4-572aa8bbf33b req-998e09bd-ab97-4d51-9f71-4b34f19997d2 service nova] Acquired lock "refresh_cache-f8df16e2-c87f-432e-a639-f4d4931d9902" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-98960891-e280-4353-95e4-572aa8bbf33b req-998e09bd-ab97-4d51-9f71-4b34f19997d2 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Refreshing network info cache for port ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Start _get_guest_xml network_info=[{"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json -f qcow2 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-898f448d-1b84-41b2-891e-60100f855e89 req-d1679f08-4473-445f-9cfb-0781ba7f7143 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-changed-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-898f448d-1b84-41b2-891e-60100f855e89 req-d1679f08-4473-445f-9cfb-0781ba7f7143 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Refreshing instance network info cache due to event network-changed-17a4e939-dd34-4c8e-b254-079202ca1814. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-898f448d-1b84-41b2-891e-60100f855e89 req-d1679f08-4473-445f-9cfb-0781ba7f7143 service nova] Acquiring lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-898f448d-1b84-41b2-891e-60100f855e89 req-d1679f08-4473-445f-9cfb-0781ba7f7143 service nova] Acquired lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-898f448d-1b84-41b2-891e-60100f855e89 req-d1679f08-4473-445f-9cfb-0781ba7f7143 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Refreshing network info cache for port 17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:59:40 user nova-compute[76161]: INFO os_vif [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd')
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrmvRgVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:40 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-90321100',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-90321100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9032110',id=33,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo7dqhfnJu0Dztv8ibR8N4Sq+F72M+JR6+7OzluphnrpmT06delzCOggQW1UCV+7Igscw2sJC+xrr3K0qWCgT6UggvZOVKX0+wFfl1D7T8hS9Jw0vckTVLUW7Ohlk7HbQ==',key_name='tempest-keypair-684407785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92344de47ffa4a5883115469db09b283',ramdisk_id='',reservation_id='r-czenygfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-937613309',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cbac0f2bd224fc88b8b1bbb332fd793',uuid=f8df16e2-c87f-432e-a639-f4d4931d9902,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Converting VIF {"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b7:11,bridge_name='br-int',has_traffic_filtering=True,id=ac8b1015-35a1-4861-ada7-d67db570f0c2,network=Network(90913d1b-1c61-41b9-b08b-31f15dce9ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8b1015-35') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.objects.instance [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lazy-loading 'pci_devices' on Instance uuid f8df16e2-c87f-432e-a639-f4d4931d9902 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11dd4e7-97d2-4810-9d9a-5c1afd896b34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:59:40 user nova-compute[76161]: No targets found.
Nov 14 17:59:40 user nova-compute[76161]: iSNS:
Nov 14 17:59:40 user nova-compute[76161]: No targets found.
Nov 14 17:59:40 user nova-compute[76161]: STATIC:
Nov 14 17:59:40 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 17:59:40 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:59:40 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:59:40 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:59:40 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:59:40 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:59:40 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752
Nov 14 17:59:40 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:59:40 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:59:40 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 17:59:40 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:59:40 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:59:40 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9
Nov 14 17:59:40 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:59:40 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:59:40 user nova-compute[76161]: FIRMWARE:
Nov 14 17:59:40 user nova-compute[76161]: No targets found.
Nov 14 17:59:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:59:40 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:59:40 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:59:40 user nova-compute[76161]:   <uuid>f8df16e2-c87f-432e-a639-f4d4931d9902</uuid>
Nov 14 17:59:40 user nova-compute[76161]:   <name>instance-00000021</name>
Nov 14 17:59:40 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:59:40 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:59:40 user nova-compute[76161]:   <metadata>
Nov 14 17:59:40 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:59:40 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:59:40 user nova-compute[76161]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-90321100</nova:name>
Nov 14 17:59:40 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:59:40</nova:creationTime>
Nov 14 17:59:40 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:59:40 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:59:40 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:59:40 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:59:40 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:59:40 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:59:40 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:59:40 user nova-compute[76161]:       <nova:owner>
Nov 14 17:59:40 user nova-compute[76161]:         <nova:user uuid="8cbac0f2bd224fc88b8b1bbb332fd793">tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member</nova:user>
Nov 14 17:59:40 user nova-compute[76161]:         <nova:project uuid="92344de47ffa4a5883115469db09b283">tempest-TestServerVolumeAttachScenarioOldVersion-937613309</nova:project>
Nov 14 17:59:40 user nova-compute[76161]:       </nova:owner>
Nov 14 17:59:40 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:59:40 user nova-compute[76161]:       <nova:ports>
Nov 14 17:59:40 user nova-compute[76161]:         <nova:port uuid="ac8b1015-35a1-4861-ada7-d67db570f0c2">
Nov 14 17:59:40 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 17:59:40 user nova-compute[76161]:         </nova:port>
Nov 14 17:59:40 user nova-compute[76161]:       </nova:ports>
Nov 14 17:59:40 user nova-compute[76161]:     </nova:instance>
Nov 14 17:59:40 user nova-compute[76161]:   </metadata>
Nov 14 17:59:40 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:59:40 user nova-compute[76161]:     <system>
Nov 14 17:59:40 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:59:40 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:59:40 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:59:40 user nova-compute[76161]:       <entry name="serial">f8df16e2-c87f-432e-a639-f4d4931d9902</entry>
Nov 14 17:59:40 user nova-compute[76161]:       <entry name="uuid">f8df16e2-c87f-432e-a639-f4d4931d9902</entry>
Nov 14 17:59:40 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:59:40 user nova-compute[76161]:     </system>
Nov 14 17:59:40 user nova-compute[76161]:   </sysinfo>
Nov 14 17:59:40 user nova-compute[76161]:   <os>
Nov 14 17:59:40 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:59:40 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:59:40 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:59:40 user nova-compute[76161]:   </os>
Nov 14 17:59:40 user nova-compute[76161]:   <features>
Nov 14 17:59:40 user nova-compute[76161]:     <acpi/>
Nov 14 17:59:40 user nova-compute[76161]:     <apic/>
Nov 14 17:59:40 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:59:40 user nova-compute[76161]:   </features>
Nov 14 17:59:40 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:59:40 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:59:40 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:59:40 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:59:40 user nova-compute[76161]:   </clock>
Nov 14 17:59:40 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:59:40 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:59:40 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:59:40 user nova-compute[76161]:   </cpu>
Nov 14 17:59:40 user nova-compute[76161]:   <devices>
Nov 14 17:59:40 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:59:40 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:59:40 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk"/>
Nov 14 17:59:40 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:59:40 user nova-compute[76161]:     </disk>
Nov 14 17:59:40 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:59:40 user nova-compute[76161]:       <mac address="fa:16:3e:d7:b7:11"/>
Nov 14 17:59:40 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:59:40 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:59:40 user nova-compute[76161]:       <target dev="tapac8b1015-35"/>
Nov 14 17:59:40 user nova-compute[76161]:     </interface>
Nov 14 17:59:40 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:59:40 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/console.log" append="off"/>
Nov 14 17:59:40 user nova-compute[76161]:     </serial>
Nov 14 17:59:40 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:59:40 user nova-compute[76161]:     <video>
Nov 14 17:59:40 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:59:40 user nova-compute[76161]:     </video>
Nov 14 17:59:40 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:59:40 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:59:40 user nova-compute[76161]:     </rng>
Nov 14 17:59:40 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:59:40 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:59:40 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:59:40 user nova-compute[76161]:     </memballoon>
Nov 14 17:59:40 user nova-compute[76161]:   </devices>
Nov 14 17:59:40 user nova-compute[76161]: </domain>
Nov 14 17:59:40 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-90321100',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-90321100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9032110',id=33,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo7dqhfnJu0Dztv8ibR8N4Sq+F72M+JR6+7OzluphnrpmT06delzCOggQW1UCV+7Igscw2sJC+xrr3K0qWCgT6UggvZOVKX0+wFfl1D7T8hS9Jw0vckTVLUW7Ohlk7HbQ==',key_name='tempest-keypair-684407785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92344de47ffa4a5883115469db09b283',ramdisk_id='',reservation_id='r-czenygfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-937613309',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cbac0f2bd224fc88b8b1bbb332fd793',uuid=f8df16e2-c87f-432e-a639-f4d4931d9902,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Converting VIF {"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b7:11,bridge_name='br-int',has_traffic_filtering=True,id=ac8b1015-35a1-4861-ada7-d67db570f0c2,network=Network(90913d1b-1c61-41b9-b08b-31f15dce9ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8b1015-35') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_vif [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b7:11,bridge_name='br-int',has_traffic_filtering=True,id=ac8b1015-35a1-4861-ada7-d67db570f0c2,network=Network(90913d1b-1c61-41b9-b08b-31f15dce9ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8b1015-35') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd23cfc49-d8cd-5493-b71e-3a1e8a527619', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7191b8f7-9f77-4820-bd08-f758a3c90eba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac8b1015-35, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac8b1015-35, col_values=(('qos', UUID('a1bde732-3855-443e-a857-4439403ecead')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac8b1015-35, col_values=(('external_ids', {'iface-id': 'ac8b1015-35a1-4861-ada7-d67db570f0c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:b7:11', 'vm-uuid': 'f8df16e2-c87f-432e-a639-f4d4931d9902'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json -f qcow2 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9de52ae-9ad6-4e0f-8ef2-2c8753e84047]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:40 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:40 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:40 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:40 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 17:59:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:40 user nova-compute[76161]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 17:59:40 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:40 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:40 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 17:59:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0782d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a'): ({'sdf'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Removing single pathed devices sdf {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:59:40 user nova-compute[76161]: INFO os_vif [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b7:11,bridge_name='br-int',has_traffic_filtering=True,id=ac8b1015-35a1-4861-ada7-d67db570f0c2,network=Network(90913d1b-1c61-41b9-b08b-31f15dce9ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8b1015-35')
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceba18f-9f7f-460f-8ff7-489e641303f6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18fa179-4985-48f2-9b02-840c6949593e]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Flushing IO for device /dev/sdf {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[803be585-377b-4133-b51b-342b73bb4086]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] No VIF found with MAC fa:16:3e:d7:b7:11, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.065s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a85769a-4f7d-4576-be50-5447f9da154a]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef53070c-a982-44d5-8565-c178bab9fe3a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-98960891-e280-4353-95e4-572aa8bbf33b req-998e09bd-ab97-4d51-9f71-4b34f19997d2 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Updated VIF entry in instance network info cache for port ac8b1015-35a1-4861-ada7-d67db570f0c2. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-98960891-e280-4353-95e4-572aa8bbf33b req-998e09bd-ab97-4d51-9f71-4b34f19997d2 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Updating instance_info_cache with network_info: [{"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-98960891-e280-4353-95e4-572aa8bbf33b req-998e09bd-ab97-4d51-9f71-4b34f19997d2 service nova] Releasing lock "refresh_cache-f8df16e2-c87f-432e-a639-f4d4931d9902" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b535e-3218-4c39-b52f-d0da8ddc74d2]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260]
Nov 14 17:59:40 user nova-compute[76161]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260] successful.
Nov 14 17:59:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-898f448d-1b84-41b2-891e-60100f855e89 req-d1679f08-4473-445f-9cfb-0781ba7f7143 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updated VIF entry in instance network info cache for port 17a4e939-dd34-4c8e-b254-079202ca1814. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-898f448d-1b84-41b2-891e-60100f855e89 req-d1679f08-4473-445f-9cfb-0781ba7f7143 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating instance_info_cache with network_info: [{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": null, "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap17a4e939-dd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a020dc10-bd9f-4123-a515-7e31588bf42b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.509s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] <== disconnect_volume: return (511ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:59:40 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Deleting instance files /opt/stack/data/nova/instances/c6f53da9-e029-4aa7-8dad-edd41eb2eb5d_del
Nov 14 17:59:40 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Deletion of /opt/stack/data/nova/instances/c6f53da9-e029-4aa7-8dad-edd41eb2eb5d_del complete
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-898f448d-1b84-41b2-891e-60100f855e89 req-d1679f08-4473-445f-9cfb-0781ba7f7143 service nova] Releasing lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.221s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjkkc6j1z/e911d98a96e8416aafc742c4e1ebd9dd.delta 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjkkc6j1z/e911d98a96e8416aafc742c4e1ebd9dd.delta 1073741824" returned: 0 in 0.060s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:40 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 17:59:41 user nova-compute[76161]: DEBUG nova.compute.manager [req-3cf89006-12b7-4a53-be97-b951a3a7381e req-b030768b-15f7-4b61-a70f-42dbd89aba30 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3cf89006-12b7-4a53-be97-b951a3a7381e req-b030768b-15f7-4b61-a70f-42dbd89aba30 service nova] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3cf89006-12b7-4a53-be97-b951a3a7381e req-b030768b-15f7-4b61-a70f-42dbd89aba30 service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3cf89006-12b7-4a53-be97-b951a3a7381e req-b030768b-15f7-4b61-a70f-42dbd89aba30 service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:41 user nova-compute[76161]: DEBUG nova.compute.manager [req-3cf89006-12b7-4a53-be97-b951a3a7381e req-b030768b-15f7-4b61-a70f-42dbd89aba30 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] No waiting events found dispatching network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:41 user nova-compute[76161]: WARNING nova.compute.manager [req-3cf89006-12b7-4a53-be97-b951a3a7381e req-b030768b-15f7-4b61-a70f-42dbd89aba30 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received unexpected event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 for instance with vm_state active and task_state shelving.
Nov 14 17:59:41 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Deleted allocations for instance c6f53da9-e029-4aa7-8dad-edd41eb2eb5d
Nov 14 17:59:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:41 user nova-compute[76161]: DEBUG nova.objects.instance [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lazy-loading 'numa_topology' on Instance uuid c6f53da9-e029-4aa7-8dad-edd41eb2eb5d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:41 user nova-compute[76161]: DEBUG nova.objects.base [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Object Instance<c6f53da9-e029-4aa7-8dad-edd41eb2eb5d> lazy-loaded attributes: resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] COPY block job progress, current cursor: 196608 final cursor: 75497472 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.738s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 17:59:42 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lazy-loading 'flavor' on Instance uuid 952593b7-cc8b-4d50-8aa8-a50e385e088b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-55eb29ac-a49f-4d25-9415-fc4faba987f7 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.364s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-c1fe2a60-f459-4a38-9c3a-720f6f884b8b req-b5d3c1d6-d738-4912-875a-3be7e486b0df service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received event network-vif-plugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c1fe2a60-f459-4a38-9c3a-720f6f884b8b req-b5d3c1d6-d738-4912-875a-3be7e486b0df service nova] Acquiring lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c1fe2a60-f459-4a38-9c3a-720f6f884b8b req-b5d3c1d6-d738-4912-875a-3be7e486b0df service nova] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c1fe2a60-f459-4a38-9c3a-720f6f884b8b req-b5d3c1d6-d738-4912-875a-3be7e486b0df service nova] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-c1fe2a60-f459-4a38-9c3a-720f6f884b8b req-b5d3c1d6-d738-4912-875a-3be7e486b0df service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] No waiting events found dispatching network-vif-plugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:42 user nova-compute[76161]: WARNING nova.compute.manager [req-c1fe2a60-f459-4a38-9c3a-720f6f884b8b req-b5d3c1d6-d738-4912-875a-3be7e486b0df service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received unexpected event network-vif-plugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 for instance with vm_state building and task_state spawning.
Nov 14 17:59:42 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjkkc6j1z/e911d98a96e8416aafc742c4e1ebd9dd.delta /opt/stack/data/nova/instances/snapshots/tmpjkkc6j1z/e911d98a96e8416aafc742c4e1ebd9dd {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:42 user nova-compute[76161]: INFO nova.compute.manager [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Attaching volume 9b528b94-5ba7-4c99-8f41-19727d3ffa3c to /dev/vdc
Nov 14 17:59:43 user nova-compute[76161]: DEBUG os_brick.utils [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d496bf36-e977-4d06-af0f-7020761c7dae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9e479c-ded6-43a4-bf02-28e559092ede]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aa2bc8-acbf-4566-b55c-e2f61f00d30e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3caa37-51f0-47c9-90b2-9c1665569a50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:59:43 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[004a83e3-8cb7-48fb-9aee-dddb26c9f633]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG os_brick.utils [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Updating existing volume attachment record: 6d2bc9f9-83d3-4a11-92a9-473f90857da1 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:59:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjkkc6j1z/e911d98a96e8416aafc742c4e1ebd9dd.delta /opt/stack/data/nova/instances/snapshots/tmpjkkc6j1z/e911d98a96e8416aafc742c4e1ebd9dd" returned: 0 in 0.568s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:43 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Snapshot extracted, beginning image upload
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.compute.manager [req-461a61cd-03c7-488b-a323-3e66d5a9ec1d req-79a7ac5c-41f5-469a-9b09-2353b9d8dcaa service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received event network-vif-plugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-461a61cd-03c7-488b-a323-3e66d5a9ec1d req-79a7ac5c-41f5-469a-9b09-2353b9d8dcaa service nova] Acquiring lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-461a61cd-03c7-488b-a323-3e66d5a9ec1d req-79a7ac5c-41f5-469a-9b09-2353b9d8dcaa service nova] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-461a61cd-03c7-488b-a323-3e66d5a9ec1d req-79a7ac5c-41f5-469a-9b09-2353b9d8dcaa service nova] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.compute.manager [req-461a61cd-03c7-488b-a323-3e66d5a9ec1d req-79a7ac5c-41f5-469a-9b09-2353b9d8dcaa service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] No waiting events found dispatching network-vif-plugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:59:44 user nova-compute[76161]: WARNING nova.compute.manager [req-461a61cd-03c7-488b-a323-3e66d5a9ec1d req-79a7ac5c-41f5-469a-9b09-2353b9d8dcaa service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received unexpected event network-vif-plugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 for instance with vm_state building and task_state spawning.
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:59:44 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Instance spawned successfully.
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:59:44 user nova-compute[76161]: INFO nova.compute.manager [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Took 7.05 seconds to spawn the instance on the hypervisor.
Nov 14 17:59:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:59:45 user nova-compute[76161]: INFO nova.compute.manager [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Took 8.07 seconds to build instance.
Nov 14 17:59:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-82042e0b-3af7-4f96-9e3d-491bc54ed767 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.205s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:46 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Snapshot image upload complete
Nov 14 17:59:46 user nova-compute[76161]: INFO nova.compute.manager [None req-5365f2b2-fde4-495d-a01d-2100e06485e7 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Took 6.24 seconds to snapshot the instance on the hypervisor.
Nov 14 17:59:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jcKLCipr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:47 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:59:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:59:47 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:59:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:59:47 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:59:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fc366b-3b50-4113-8087-9866c92ff858]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:59:47 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5f5a36-bc4d-467a-8714-67ea5b187ab1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c] added
Nov 14 17:59:47 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.103s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d98dca9-fc59-4e8f-80eb-a0eca7e3232b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.065s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cc7bb0-4598-43c7-8a29-f259a249dea0]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jcKLCipr {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jcKLCipr" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8bc80c-a8fa-4749-8743-742e556f9d86]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jcKLCipr'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.052s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c777ad7-bcab-4618-abfd-e50176c48970]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa28ff2e-27da-487d-b8ea-40e50349b9b5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec77657-dc1d-43cb-b49f-d644cadc2d1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c, portal: 172.16.0.220,3260]
Nov 14 17:59:48 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c, portal: 172.16.0.220,3260] successful.
Nov 14 17:59:48 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e56f80-7fcc-438f-9936-d911c6c6b2d2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d556d98-57ef-4694-9176-a96255c898bb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)
Nov 14 17:59:48 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 17:59:48 user nova-compute[76161]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)
Nov 14 17:59:48 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.510s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9d8d94-4b5f-424d-b529-1a642ccc243a]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:48 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jcKLCipr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.538s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] <== connect_volume: return (1539ms) {'type': 'block', 'scsi_wwn': '23438343534656633', 'path': '/dev/sdf'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438343534656633', 'path': '/dev/sdf'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lazy-loading 'flavor' on Instance uuid 952593b7-cc8b-4d50-8aa8-a50e385e088b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:59:49 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:59:49 user nova-compute[76161]:   <source dev="/dev/sdf"/>
Nov 14 17:59:49 user nova-compute[76161]:   <target dev="vdc" bus="virtio"/>
Nov 14 17:59:49 user nova-compute[76161]:   <serial>9b528b94-5ba7-4c99-8f41-19727d3ffa3c</serial>
Nov 14 17:59:49 user nova-compute[76161]: </disk>
Nov 14 17:59:49 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] No VIF found with MAC fa:16:3e:29:91:d7, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:59:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0552ef8f-0cc2-4eb8-ad37-635099d08e48 tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.092s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:50 user nova-compute[76161]: INFO nova.compute.manager [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Detaching volume 9b528b94-5ba7-4c99-8f41-19727d3ffa3c
Nov 14 17:59:50 user nova-compute[76161]: INFO nova.virt.block_device [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Attempting to driver detach volume 9b528b94-5ba7-4c99-8f41-19727d3ffa3c from mountpoint /dev/vdc
Nov 14 17:59:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Attempting to detach device vdc from instance 952593b7-cc8b-4d50-8aa8-a50e385e088b from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:59:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:59:50 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:59:50 user nova-compute[76161]:   <source dev="/dev/sdf"/>
Nov 14 17:59:50 user nova-compute[76161]:   <target dev="vdc" bus="virtio"/>
Nov 14 17:59:50 user nova-compute[76161]:   <serial>9b528b94-5ba7-4c99-8f41-19727d3ffa3c</serial>
Nov 14 17:59:50 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 17:59:50 user nova-compute[76161]: </disk>
Nov 14 17:59:50 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:59:50 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Successfully detached device vdc from instance 952593b7-cc8b-4d50-8aa8-a50e385e088b from the persistent domain config.
Nov 14 17:59:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 952593b7-cc8b-4d50-8aa8-a50e385e088b from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:59:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:59:50 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:59:50 user nova-compute[76161]:   <source dev="/dev/sdf"/>
Nov 14 17:59:50 user nova-compute[76161]:   <target dev="vdc" bus="virtio"/>
Nov 14 17:59:50 user nova-compute[76161]:   <serial>9b528b94-5ba7-4c99-8f41-19727d3ffa3c</serial>
Nov 14 17:59:50 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 17:59:50 user nova-compute[76161]: </disk>
Nov 14 17:59:50 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:59:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 952593b7-cc8b-4d50-8aa8-a50e385e088b {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-3eaca758-3234-4a71-a7a0-27c04615c695 req-9d8f61c8-d34c-488c-bc12-c87a43e831cf service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received event network-changed-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-3eaca758-3234-4a71-a7a0-27c04615c695 req-9d8f61c8-d34c-488c-bc12-c87a43e831cf service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Refreshing instance network info cache due to event network-changed-1b5e3434-bed5-4f47-8004-ed361e773df0. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3eaca758-3234-4a71-a7a0-27c04615c695 req-9d8f61c8-d34c-488c-bc12-c87a43e831cf service nova] Acquiring lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3eaca758-3234-4a71-a7a0-27c04615c695 req-9d8f61c8-d34c-488c-bc12-c87a43e831cf service nova] Acquired lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-3eaca758-3234-4a71-a7a0-27c04615c695 req-9d8f61c8-d34c-488c-bc12-c87a43e831cf service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Refreshing network info cache for port 1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-3eaca758-3234-4a71-a7a0-27c04615c695 req-9d8f61c8-d34c-488c-bc12-c87a43e831cf service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Updated VIF entry in instance network info cache for port 1b5e3434-bed5-4f47-8004-ed361e773df0. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-3eaca758-3234-4a71-a7a0-27c04615c695 req-9d8f61c8-d34c-488c-bc12-c87a43e831cf service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Updating instance_info_cache with network_info: [{"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3eaca758-3234-4a71-a7a0-27c04615c695 req-9d8f61c8-d34c-488c-bc12-c87a43e831cf service nova] Releasing lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:54 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 is timed out.
Nov 14 17:59:54 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Successfully detached device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the live domain config.
Nov 14 17:59:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGuvIlae', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:54 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9663c328-db37-4599-a9cb-5be66cbd7761]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:59:54 user nova-compute[76161]: No targets found.
Nov 14 17:59:54 user nova-compute[76161]: iSNS:
Nov 14 17:59:54 user nova-compute[76161]: No targets found.
Nov 14 17:59:54 user nova-compute[76161]: STATIC:
Nov 14 17:59:54 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c
Nov 14 17:59:54 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:59:54 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:59:54 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 17:59:54 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:59:54 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:59:54 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 17:59:54 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:59:54 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:59:54 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752
Nov 14 17:59:54 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:59:54 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:59:54 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9
Nov 14 17:59:54 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:59:54 user nova-compute[76161]:                 Iface Name: default
Nov 14 17:59:54 user nova-compute[76161]: FIRMWARE:
Nov 14 17:59:54 user nova-compute[76161]: No targets found.
Nov 14 17:59:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:59:54 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:59:54 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[777b9f09-473a-4890-8efd-09b29d63be21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd5f8de-f8ab-4eee-8408-37c422883c9a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:54 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:54 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:54 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 17:59:54 user nova-compute[76161]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)
Nov 14 17:59:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 17:59:54 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 17:59:54 user nova-compute[76161]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 (non-flash)
Nov 14 17:59:54 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 17:59:54 user nova-compute[76161]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)
Nov 14 17:59:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f012a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cb7628-8fbb-4229-b855-cb590bc24b14]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f6573c-8800-4fa0-89fe-8ceb04afde05]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG nova.objects.instance [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lazy-loading 'flavor' on Instance uuid 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7924d36e-cd57-4fe9-8db0-06ab29396bbc]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f36894-fe5d-4a59-a098-0fb1ef3e9532]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:59:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e15b9c-8b01-44a8-a71c-bdfca570f9aa]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf05f13-bf36-484c-9d57-83ed77b34a65]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9, portal: 172.16.0.220,3260]
Nov 14 17:59:55 user nova-compute[76161]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9, portal: 172.16.0.220,3260] successful.
Nov 14 17:59:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daecbb1-4b96-4cbc-a966-540c410d44a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f97af2-82ae-42b6-a032-179a753d9b4a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== disconnect_volume: return (345ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:55 user nova-compute[76161]: INFO nova.compute.manager [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Attaching volume f1f567e8-bfc3-465b-8526-4479a124360d to /dev/vdb
Nov 14 17:59:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.utils [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da3e2c0-1afd-4347-99da-f92ec98ece56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfebd11-27f7-4440-8a4b-9835600017c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dd071a-9f2b-4765-8ed4-780663e5ea0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8667746-721a-4f77-ab1d-97ebf4704c88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:59:55 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a6d88-4b9b-4487-8992-3cca394776b6]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG os_brick.utils [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Updating existing volume attachment record: 062709b5-4bda-4b6b-ba7d-29cd59a2f116 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "1653be4a-11b6-43cb-996a-d759761c8411" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:59:55 user nova-compute[76161]: INFO nova.compute.claims [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Claim successful on node user
Nov 14 17:59:55 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d5774ac7-6863-48df-be4d-4e6590667f4e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:59:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:59:56 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG nova.policy [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49edd5581ca44780ac590c2b072b338d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45eab8e344af47a2b1b28fa471a4acc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:59:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Creating image(s)
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "/opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "/opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "/opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.214s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk 1073741824" returned: 0 in 0.061s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Successfully created port: d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Cannot resize image /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Ensure instance console log exists: /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Successfully updated port: d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "refresh_cache-1653be4a-11b6-43cb-996a-d759761c8411" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquired lock "refresh_cache-1653be4a-11b6-43cb-996a-d759761c8411" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-b47bcdef-a9a4-4ddb-8335-d8d096034bae req-32e641a5-26e8-45c9-9707-b687ddb4e137 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received event network-changed-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-b47bcdef-a9a4-4ddb-8335-d8d096034bae req-32e641a5-26e8-45c9-9707-b687ddb4e137 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Refreshing instance network info cache due to event network-changed-d4512664-4563-48f2-bc29-c9a857f8577e. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:59:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b47bcdef-a9a4-4ddb-8335-d8d096034bae req-32e641a5-26e8-45c9-9707-b687ddb4e137 service nova] Acquiring lock "refresh_cache-1653be4a-11b6-43cb-996a-d759761c8411" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.network.neutron [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Updating instance_info_cache with network_info: [{"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Releasing lock "refresh_cache-1653be4a-11b6-43cb-996a-d759761c8411" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Instance network_info: |[{"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b47bcdef-a9a4-4ddb-8335-d8d096034bae req-32e641a5-26e8-45c9-9707-b687ddb4e137 service nova] Acquired lock "refresh_cache-1653be4a-11b6-43cb-996a-d759761c8411" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.network.neutron [req-b47bcdef-a9a4-4ddb-8335-d8d096034bae req-32e641a5-26e8-45c9-9707-b687ddb4e137 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Refreshing network info cache for port d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Start _get_guest_xml network_info=[{"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:59:58 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:58 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-876742116',display_name='tempest-AttachVolumeNegativeTest-server-876742116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-876742116',id=34,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6rAF/2Zvnif1MTi0/VlVEsbmX8VSlUtPPMj6epBcYSQ2bdgx+NU7+k1qRZjcaRrmsqX31WqnLvby6cD0TEK1svh8ekWsHsIVjIDj9NcW+w3kFZgqCBzfYx8Sb+F06U7Q==',key_name='tempest-keypair-1492604258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-yburnmt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=1653be4a-11b6-43cb-996a-d759761c8411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cc:f6,bridge_name='br-int',has_traffic_filtering=True,id=d4512664-4563-48f2-bc29-c9a857f8577e,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4512664-45') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'pci_devices' on Instance uuid 1653be4a-11b6-43cb-996a-d759761c8411 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:59:58 user nova-compute[76161]:   <uuid>1653be4a-11b6-43cb-996a-d759761c8411</uuid>
Nov 14 17:59:58 user nova-compute[76161]:   <name>instance-00000022</name>
Nov 14 17:59:58 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 17:59:58 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 17:59:58 user nova-compute[76161]:   <metadata>
Nov 14 17:59:58 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:59:58 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 17:59:58 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeNegativeTest-server-876742116</nova:name>
Nov 14 17:59:58 user nova-compute[76161]:       <nova:creationTime>2023-11-14 17:59:58</nova:creationTime>
Nov 14 17:59:58 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 17:59:58 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 17:59:58 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 17:59:58 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 17:59:58 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:59:58 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:59:58 user nova-compute[76161]:       </nova:flavor>
Nov 14 17:59:58 user nova-compute[76161]:       <nova:owner>
Nov 14 17:59:58 user nova-compute[76161]:         <nova:user uuid="49edd5581ca44780ac590c2b072b338d">tempest-AttachVolumeNegativeTest-453609882-project-member</nova:user>
Nov 14 17:59:58 user nova-compute[76161]:         <nova:project uuid="45eab8e344af47a2b1b28fa471a4acc3">tempest-AttachVolumeNegativeTest-453609882</nova:project>
Nov 14 17:59:58 user nova-compute[76161]:       </nova:owner>
Nov 14 17:59:58 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 17:59:58 user nova-compute[76161]:       <nova:ports>
Nov 14 17:59:58 user nova-compute[76161]:         <nova:port uuid="d4512664-4563-48f2-bc29-c9a857f8577e">
Nov 14 17:59:58 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 17:59:58 user nova-compute[76161]:         </nova:port>
Nov 14 17:59:58 user nova-compute[76161]:       </nova:ports>
Nov 14 17:59:58 user nova-compute[76161]:     </nova:instance>
Nov 14 17:59:58 user nova-compute[76161]:   </metadata>
Nov 14 17:59:58 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 17:59:58 user nova-compute[76161]:     <system>
Nov 14 17:59:58 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:59:58 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:59:58 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 17:59:58 user nova-compute[76161]:       <entry name="serial">1653be4a-11b6-43cb-996a-d759761c8411</entry>
Nov 14 17:59:58 user nova-compute[76161]:       <entry name="uuid">1653be4a-11b6-43cb-996a-d759761c8411</entry>
Nov 14 17:59:58 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:59:58 user nova-compute[76161]:     </system>
Nov 14 17:59:58 user nova-compute[76161]:   </sysinfo>
Nov 14 17:59:58 user nova-compute[76161]:   <os>
Nov 14 17:59:58 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:59:58 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 17:59:58 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 17:59:58 user nova-compute[76161]:   </os>
Nov 14 17:59:58 user nova-compute[76161]:   <features>
Nov 14 17:59:58 user nova-compute[76161]:     <acpi/>
Nov 14 17:59:58 user nova-compute[76161]:     <apic/>
Nov 14 17:59:58 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 17:59:58 user nova-compute[76161]:   </features>
Nov 14 17:59:58 user nova-compute[76161]:   <clock offset="utc">
Nov 14 17:59:58 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:59:58 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:59:58 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 17:59:58 user nova-compute[76161]:   </clock>
Nov 14 17:59:58 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 17:59:58 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 17:59:58 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:59:58 user nova-compute[76161]:   </cpu>
Nov 14 17:59:58 user nova-compute[76161]:   <devices>
Nov 14 17:59:58 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 17:59:58 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:59:58 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk"/>
Nov 14 17:59:58 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 17:59:58 user nova-compute[76161]:     </disk>
Nov 14 17:59:58 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 17:59:58 user nova-compute[76161]:       <mac address="fa:16:3e:6b:cc:f6"/>
Nov 14 17:59:58 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:59:58 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 17:59:58 user nova-compute[76161]:       <target dev="tapd4512664-45"/>
Nov 14 17:59:58 user nova-compute[76161]:     </interface>
Nov 14 17:59:58 user nova-compute[76161]:     <serial type="pty">
Nov 14 17:59:58 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/console.log" append="off"/>
Nov 14 17:59:58 user nova-compute[76161]:     </serial>
Nov 14 17:59:58 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:59:58 user nova-compute[76161]:     <video>
Nov 14 17:59:58 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 17:59:58 user nova-compute[76161]:     </video>
Nov 14 17:59:58 user nova-compute[76161]:     <rng model="virtio">
Nov 14 17:59:58 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:59:58 user nova-compute[76161]:     </rng>
Nov 14 17:59:58 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:59:58 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 17:59:58 user nova-compute[76161]:       <stats period="10"/>
Nov 14 17:59:58 user nova-compute[76161]:     </memballoon>
Nov 14 17:59:58 user nova-compute[76161]:   </devices>
Nov 14 17:59:58 user nova-compute[76161]: </domain>
Nov 14 17:59:58 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-876742116',display_name='tempest-AttachVolumeNegativeTest-server-876742116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-876742116',id=34,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6rAF/2Zvnif1MTi0/VlVEsbmX8VSlUtPPMj6epBcYSQ2bdgx+NU7+k1qRZjcaRrmsqX31WqnLvby6cD0TEK1svh8ekWsHsIVjIDj9NcW+w3kFZgqCBzfYx8Sb+F06U7Q==',key_name='tempest-keypair-1492604258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-yburnmt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=1653be4a-11b6-43cb-996a-d759761c8411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cc:f6,bridge_name='br-int',has_traffic_filtering=True,id=d4512664-4563-48f2-bc29-c9a857f8577e,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4512664-45') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG os_vif [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cc:f6,bridge_name='br-int',has_traffic_filtering=True,id=d4512664-4563-48f2-bc29-c9a857f8577e,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4512664-45') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ea7b2b9-c51b-50b1-ba14-c11cdb176766', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4512664-45, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4512664-45, col_values=(('qos', UUID('7a027b48-06de-4122-bc29-b62b46b4315c')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4512664-45, col_values=(('external_ids', {'iface-id': 'd4512664-4563-48f2-bc29-c9a857f8577e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:cc:f6', 'vm-uuid': '1653be4a-11b6-43cb-996a-d759761c8411'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:58 user nova-compute[76161]: INFO os_vif [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:cc:f6,bridge_name='br-int',has_traffic_filtering=True,id=d4512664-4563-48f2-bc29-c9a857f8577e,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4512664-45')
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No VIF found with MAC fa:16:3e:6b:cc:f6, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.network.neutron [req-b47bcdef-a9a4-4ddb-8335-d8d096034bae req-32e641a5-26e8-45c9-9707-b687ddb4e137 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Updated VIF entry in instance network info cache for port d4512664-4563-48f2-bc29-c9a857f8577e. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG nova.network.neutron [req-b47bcdef-a9a4-4ddb-8335-d8d096034bae req-32e641a5-26e8-45c9-9707-b687ddb4e137 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Updating instance_info_cache with network_info: [{"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:59:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b47bcdef-a9a4-4ddb-8335-d8d096034bae req-32e641a5-26e8-45c9-9707-b687ddb4e137 service nova] Releasing lock "refresh_cache-1653be4a-11b6-43cb-996a-d759761c8411" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:59:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:59:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-7cae3d68-614f-4b2e-ba15-4aa21b90ce2f req-97162544-7bde-4686-b415-4d34cdd803d2 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received event network-vif-plugged-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7cae3d68-614f-4b2e-ba15-4aa21b90ce2f req-97162544-7bde-4686-b415-4d34cdd803d2 service nova] Acquiring lock "1653be4a-11b6-43cb-996a-d759761c8411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7cae3d68-614f-4b2e-ba15-4aa21b90ce2f req-97162544-7bde-4686-b415-4d34cdd803d2 service nova] Lock "1653be4a-11b6-43cb-996a-d759761c8411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7cae3d68-614f-4b2e-ba15-4aa21b90ce2f req-97162544-7bde-4686-b415-4d34cdd803d2 service nova] Lock "1653be4a-11b6-43cb-996a-d759761c8411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-7cae3d68-614f-4b2e-ba15-4aa21b90ce2f req-97162544-7bde-4686-b415-4d34cdd803d2 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] No waiting events found dispatching network-vif-plugged-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:00 user nova-compute[76161]: WARNING nova.compute.manager [req-7cae3d68-614f-4b2e-ba15-4aa21b90ce2f req-97162544-7bde-4686-b415-4d34cdd803d2 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received unexpected event network-vif-plugged-d4512664-4563-48f2-bc29-c9a857f8577e for instance with vm_state building and task_state spawning.
Nov 14 18:00:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZsWcKyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:00:00 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:00:00 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:00:00 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e06f7ec-9d13-424e-bb85-e956a28a993b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:00:00 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[95863cfa-24c5-4fda-82bb-e9562485f304]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d] added
Nov 14 18:00:00 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26c8540-ffdd-4350-afd3-1163229c82a8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.091s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cee982-c89b-4123-90a8-05d255822a42]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RZsWcKyA {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RZsWcKyA" returned: 0 in 0.071s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2931e85-9269-4621-92b6-2f90fd7fb676]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RZsWcKyA'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b15b64-507c-43f9-8882-bed08c4b52c5]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acf26aa-134f-48ad-a736-b8471c8ac298]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)
Nov 14 18:00:00 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)
Nov 14 18:00:00 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3cec70-84e3-4fac-8193-ef3519d92b87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d, portal: 172.16.0.220,3260]
Nov 14 18:00:00 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d, portal: 172.16.0.220,3260] successful.
Nov 14 18:00:00 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac351ed-5201-42e3-a9b9-6059d86f2392]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2fcbdd-3c04-4101-afe1-41a530d75da4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d (non-flash)
Nov 14 18:00:00 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)
Nov 14 18:00:00 user nova-compute[76161]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d (non-flash)
Nov 14 18:00:00 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a402d51-66ae-4d94-8dda-e2b819c085d3]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:00:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZsWcKyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:00:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:00:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '23938613837363164', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:00:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938613837363164', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:00:01 user nova-compute[76161]: DEBUG nova.objects.instance [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lazy-loading 'flavor' on Instance uuid 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:00:01 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:00:01 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:00:01 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:00:01 user nova-compute[76161]:   <serial>f1f567e8-bfc3-465b-8526-4479a124360d</serial>
Nov 14 18:00:01 user nova-compute[76161]: </disk>
Nov 14 18:00:01 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-5e40ef84-2c2b-457f-b00a-e17b3ebd9a07 req-9470fc63-84f4-4834-b3c7-b831a7859ca4 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received event network-vif-plugged-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5e40ef84-2c2b-457f-b00a-e17b3ebd9a07 req-9470fc63-84f4-4834-b3c7-b831a7859ca4 service nova] Acquiring lock "1653be4a-11b6-43cb-996a-d759761c8411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5e40ef84-2c2b-457f-b00a-e17b3ebd9a07 req-9470fc63-84f4-4834-b3c7-b831a7859ca4 service nova] Lock "1653be4a-11b6-43cb-996a-d759761c8411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5e40ef84-2c2b-457f-b00a-e17b3ebd9a07 req-9470fc63-84f4-4834-b3c7-b831a7859ca4 service nova] Lock "1653be4a-11b6-43cb-996a-d759761c8411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-5e40ef84-2c2b-457f-b00a-e17b3ebd9a07 req-9470fc63-84f4-4834-b3c7-b831a7859ca4 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] No waiting events found dispatching network-vif-plugged-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:02 user nova-compute[76161]: WARNING nova.compute.manager [req-5e40ef84-2c2b-457f-b00a-e17b3ebd9a07 req-9470fc63-84f4-4834-b3c7-b831a7859ca4 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received unexpected event network-vif-plugged-d4512664-4563-48f2-bc29-c9a857f8577e for instance with vm_state building and task_state spawning.
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] No VIF found with MAC fa:16:3e:7c:c2:3a, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:00:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Instance spawned successfully.
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:00:02 user nova-compute[76161]: INFO nova.compute.manager [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 14 18:00:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:00:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-09b389c0-1603-4a83-8f6e-ea1bef7cf442 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.113s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:02 user nova-compute[76161]: INFO nova.compute.manager [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Took 6.63 seconds to build instance.
Nov 14 18:00:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e9a1fd2a-154b-4cd9-990b-c2c59dc8544f tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.745s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:03 user nova-compute[76161]: INFO nova.compute.manager [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Detaching volume f1f567e8-bfc3-465b-8526-4479a124360d
Nov 14 18:00:03 user nova-compute[76161]: INFO nova.virt.block_device [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Attempting to driver detach volume f1f567e8-bfc3-465b-8526-4479a124360d from mountpoint /dev/vdb
Nov 14 18:00:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Attempting to detach device vdb from instance 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:00:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:00:04 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:00:04 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:00:04 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:00:04 user nova-compute[76161]:   <serial>f1f567e8-bfc3-465b-8526-4479a124360d</serial>
Nov 14 18:00:04 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:00:04 user nova-compute[76161]: </disk>
Nov 14 18:00:04 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:00:04 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Successfully detached device vdb from instance 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d from the persistent domain config.
Nov 14 18:00:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:00:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:00:04 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:00:04 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:00:04 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:00:04 user nova-compute[76161]:   <serial>f1f567e8-bfc3-465b-8526-4479a124360d</serial>
Nov 14 18:00:04 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:00:04 user nova-compute[76161]: </disk>
Nov 14 18:00:04 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:00:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:00:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:11 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 952593b7-cc8b-4d50-8aa8-a50e385e088b is timed out.
Nov 14 18:00:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Successfully detached device vdc from instance 952593b7-cc8b-4d50-8aa8-a50e385e088b from the live domain config.
Nov 14 18:00:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jcKLCipr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:00:11 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c51333-b1ee-421d-b49f-92b445a47a47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:00:11 user nova-compute[76161]: No targets found.
Nov 14 18:00:11 user nova-compute[76161]: iSNS:
Nov 14 18:00:11 user nova-compute[76161]: No targets found.
Nov 14 18:00:11 user nova-compute[76161]: STATIC:
Nov 14 18:00:11 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c
Nov 14 18:00:11 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:11 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:11 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:00:11 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:11 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:11 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:00:11 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:11 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:11 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752
Nov 14 18:00:11 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:11 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:11 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d
Nov 14 18:00:11 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:11 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:11 user nova-compute[76161]: FIRMWARE:
Nov 14 18:00:11 user nova-compute[76161]: No targets found.
Nov 14 18:00:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:00:11 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:00:11 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9f7605-438c-4654-970c-da922b7ad714]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a82a40-c8d4-44c0-a480-625e2a737132]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:11 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:11 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:11 user nova-compute[76161]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)
Nov 14 18:00:11 user nova-compute[76161]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d (non-flash)
Nov 14 18:00:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:11 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:11 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:11 user nova-compute[76161]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c (non-flash)
Nov 14 18:00:11 user nova-compute[76161]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d (non-flash)
Nov 14 18:00:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d07c7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c'): ({'sdf'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Removing single pathed devices sdf {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f64a465-068d-49a6-b32e-6b236fe9dcb4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fc9b1c-4545-4cb9-8f4a-74b0eba02237]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Flushing IO for device /dev/sdf {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba60f1cc-db96-4b22-98ad-15bff2875d9b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c74cc7-5801-4a61-9566-62ac37f1ce15]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[acca2b4d-fe40-4244-a04a-306ccd0979cc]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eade3c-c494-4497-a23b-ae5ac8821b3b]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c, portal: 172.16.0.220,3260]
Nov 14 18:00:11 user nova-compute[76161]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c, portal: 172.16.0.220,3260] successful.
Nov 14 18:00:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b528b94-5ba7-4c99-8f41-19727d3ffa3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[26560b5d-13c4-421e-b348-3cabc601930d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] <== disconnect_volume: return (296ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:00:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:00:12 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 18:00:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] There are 0 instances to clean {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 18:00:12 user nova-compute[76161]: DEBUG nova.objects.instance [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lazy-loading 'flavor' on Instance uuid 952593b7-cc8b-4d50-8aa8-a50e385e088b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-917514ff-05b5-4d83-8e54-fe1bf06a7f3b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.572s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:13 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:00:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:00:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:00:13 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:00:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:13 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updating instance_info_cache with network_info: [{"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:00:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:00:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:00:15 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:15 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:15 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:17 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:17 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:00:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:19 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:19 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d is timed out.
Nov 14 18:00:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Successfully detached device vdb from instance 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d from the live domain config.
Nov 14 18:00:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZsWcKyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:00:24 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b84e268-6db2-4a66-9356-090911e0b817]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:00:24 user nova-compute[76161]: No targets found.
Nov 14 18:00:24 user nova-compute[76161]: iSNS:
Nov 14 18:00:24 user nova-compute[76161]: No targets found.
Nov 14 18:00:24 user nova-compute[76161]: STATIC:
Nov 14 18:00:24 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:00:24 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:24 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:24 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:00:24 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:24 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:24 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752
Nov 14 18:00:24 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:24 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:24 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d
Nov 14 18:00:24 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:24 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:24 user nova-compute[76161]: FIRMWARE:
Nov 14 18:00:24 user nova-compute[76161]: No targets found.
Nov 14 18:00:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:00:24 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:00:24 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea89af00-0758-49c9-b5ba-b691ef29fb07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d94e4d6-ef56-4ad3-a99d-6b4af58973e3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:24 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:24 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:24 user nova-compute[76161]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d (non-flash)
Nov 14 18:00:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:24 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:24 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:24 user nova-compute[76161]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d (non-flash)
Nov 14 18:00:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0283370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e231a7cf-cbff-4828-91b7-9618619021c4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6023e6-737a-4122-a0e7-2d6eaea9e9d4]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e441eab-fc3f-4301-bdc3-d242efa9eb35]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb01c96-b9a7-48f3-8c08-4c52d26475b0]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e263f3-58c4-471e-8989-0546e48761b1]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[92315795-b331-4838-81cd-51ce8715ca57]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d, portal: 172.16.0.220,3260]
Nov 14 18:00:24 user nova-compute[76161]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d, portal: 172.16.0.220,3260] successful.
Nov 14 18:00:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f567e8-bfc3-465b-8526-4479a124360d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[257a667a-1e0f-4865-8dc6-0f820dc1ab87]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] <== disconnect_volume: return (412ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:00:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG nova.objects.instance [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lazy-loading 'flavor' on Instance uuid 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-25cc8e10-8dd2-4e5d-9622-401d2fbc7fc8 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.055s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:27 user nova-compute[76161]: INFO nova.compute.manager [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attaching volume 0748ea33-447f-4d27-b5ee-085a7e285cb1 to /dev/vdb
Nov 14 18:00:27 user nova-compute[76161]: DEBUG os_brick.utils [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7022747c-1e32-447e-878e-622f251acc56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b067edd-6948-4eba-acab-f7a986134d2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f0476f-0d74-4b42-b07d-a5d2b0cc63ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04d51a2-b69c-4937-90bf-c4cd82ef9725]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:00:27 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49435dd-0426-4e9a-9ace-3adc4ec5f648]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG os_brick.utils [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Updating existing volume attachment record: a5a2800f-e8a5-4502-9f42-55b7eb45fc5d {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:00:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:00:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=6945MB free_disk=24.954959869384766GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 75295499-8f99-4c9b-a556-c1287c61d8f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 952593b7-cc8b-4d50-8aa8-a50e385e088b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 385ef873-fc1f-46ae-90da-b75f82524b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance f8df16e2-c87f-432e-a639-f4d4931d9902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1653be4a-11b6-43cb-996a-d759761c8411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing inventories for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating ProviderTree inventory for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing aggregate associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, aggregates: None {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing trait associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.817s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:00:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76161) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 18:00:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEdLDiKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:00:31 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:00:31 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:00:31 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5cf783-3b2c-4614-a38e-5e11ef4fb591]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:00:31 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e37fa88-d498-48d3-90de-a163f2bce66d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1] added
Nov 14 18:00:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd09c020-8555-4f99-9c4a-616c3e4c5c9d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae016530-0040-4bb9-b09a-196b2e9ac9f2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEdLDiKr {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEdLDiKr" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bfe505-f142-4feb-83e1-ed2e697a9038]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CEdLDiKr'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7ca829-d411-46d8-a310-09f166da9543]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[35429391-6da0-441b-908e-914c9b1d573f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:31 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:31 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:31 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:31 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d37c1-a5cb-42e8-bd1b-464889ead83f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1, portal: 172.16.0.220,3260]
Nov 14 18:00:31 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1, portal: 172.16.0.220,3260] successful.
Nov 14 18:00:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a5c6c7-1028-48b4-9c88-0b287aafb632]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcddb86-7f26-43e3-aaef-eb0a893d7ae9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:32 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:32 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:32 user nova-compute[76161]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)
Nov 14 18:00:32 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:32 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:32 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:32 user nova-compute[76161]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)
Nov 14 18:00:32 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[919ab75f-bdea-49ac-a4ba-0ec61e198270]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:00:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEdLDiKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:00:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:00:33 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23234663734333633', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:00:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234663734333633', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:00:33 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:00:33 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:00:33 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:00:33 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:00:33 user nova-compute[76161]:   <serial>0748ea33-447f-4d27-b5ee-085a7e285cb1</serial>
Nov 14 18:00:33 user nova-compute[76161]: </disk>
Nov 14 18:00:33 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:00:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:00:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:00:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No VIF found with MAC fa:16:3e:24:51:b7, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:00:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc992d1f-81a8-40c0-963b-de8b5cbd323d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.503s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:36 user nova-compute[76161]: INFO nova.compute.manager [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Detaching volume 0748ea33-447f-4d27-b5ee-085a7e285cb1
Nov 14 18:00:36 user nova-compute[76161]: INFO nova.virt.block_device [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attempting to driver detach volume 0748ea33-447f-4d27-b5ee-085a7e285cb1 from mountpoint /dev/vdb
Nov 14 18:00:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Attempting to detach device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:00:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:00:36 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:00:36 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:00:36 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:00:36 user nova-compute[76161]:   <serial>0748ea33-447f-4d27-b5ee-085a7e285cb1</serial>
Nov 14 18:00:36 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:00:36 user nova-compute[76161]: </disk>
Nov 14 18:00:36 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:00:36 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Successfully detached device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the persistent domain config.
Nov 14 18:00:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:00:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:00:36 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:00:36 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:00:36 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:00:36 user nova-compute[76161]:   <serial>0748ea33-447f-4d27-b5ee-085a7e285cb1</serial>
Nov 14 18:00:36 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:00:36 user nova-compute[76161]: </disk>
Nov 14 18:00:36 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:00:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:00:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:41 user nova-compute[76161]: INFO nova.compute.manager [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Detaching volume e4e1e673-3aed-4b88-9155-67bfe8f54752
Nov 14 18:00:41 user nova-compute[76161]: INFO nova.virt.block_device [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Attempting to driver detach volume e4e1e673-3aed-4b88-9155-67bfe8f54752 from mountpoint /dev/vdb
Nov 14 18:00:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Attempting to detach device vdb from instance 952593b7-cc8b-4d50-8aa8-a50e385e088b from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:00:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:00:41 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:00:41 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:00:41 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:00:41 user nova-compute[76161]:   <serial>e4e1e673-3aed-4b88-9155-67bfe8f54752</serial>
Nov 14 18:00:41 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:00:41 user nova-compute[76161]: </disk>
Nov 14 18:00:41 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:00:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Successfully detached device vdb from instance 952593b7-cc8b-4d50-8aa8-a50e385e088b from the persistent domain config.
Nov 14 18:00:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 952593b7-cc8b-4d50-8aa8-a50e385e088b from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:00:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:00:41 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:00:41 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:00:41 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:00:41 user nova-compute[76161]:   <serial>e4e1e673-3aed-4b88-9155-67bfe8f54752</serial>
Nov 14 18:00:41 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:00:41 user nova-compute[76161]: </disk>
Nov 14 18:00:41 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:00:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 952593b7-cc8b-4d50-8aa8-a50e385e088b {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:00:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:00:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:00:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:00:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:48 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:00:48 user nova-compute[76161]: INFO nova.compute.claims [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Claim successful on node user
Nov 14 18:00:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.523s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:00:49 user nova-compute[76161]: INFO nova.compute.claims [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Claim successful on node user
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:00:49 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.policy [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbfeb35beb394e15bf881780f69724f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4467aca672a34c1a8f4e1735636d311b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:00:49 user nova-compute[76161]: INFO nova.virt.block_device [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Booting with volume 6101ad26-b308-4342-b713-180af5bf40fe at /dev/vda
Nov 14 18:00:49 user nova-compute[76161]: DEBUG os_brick.utils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[189df8d0-9373-474d-86d9-dfc63f442343]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3181ff3-e032-490b-9dee-66a2e416b4f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[809c625a-16c2-439b-8ecb-c9eb699091a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[330c9e4e-1dba-473b-9051-3727712f0472]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:00:49 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4834ccd2-a0bd-4dc9-8478-2532e2d6cc53]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG os_brick.utils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating existing volume attachment record: 2f9f7814-1596-48fa-91ee-56fee0f72832 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.network.neutron [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:00:49 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.policy [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4714975d06d8455788463a30e9bc5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69696059b86f44b7ae274bf8274f9843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:00:49 user nova-compute[76161]: INFO nova.virt.block_device [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Booting with volume-backed-image 1804ef46-1f05-4c8f-910b-8e52c7b69935 at /dev/vda
Nov 14 18:00:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:49 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Successfully created port: a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:00:50 user nova-compute[76161]: DEBUG nova.network.neutron [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Successfully created port: 23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:00:50 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Successfully updated port: a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:00:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:00:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquired lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:00:50 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:00:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-4d9421e8-0095-4da9-995f-dba02a5c0c70 req-1c196cbd-ed2d-46d7-b25b-df13f71c28bb service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-changed-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-4d9421e8-0095-4da9-995f-dba02a5c0c70 req-1c196cbd-ed2d-46d7-b25b-df13f71c28bb service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Refreshing instance network info cache due to event network-changed-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:00:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4d9421e8-0095-4da9-995f-dba02a5c0c70 req-1c196cbd-ed2d-46d7-b25b-df13f71c28bb service nova] Acquiring lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:00:50 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating instance_info_cache with network_info: [{"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Releasing lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Instance network_info: |[{"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4d9421e8-0095-4da9-995f-dba02a5c0c70 req-1c196cbd-ed2d-46d7-b25b-df13f71c28bb service nova] Acquired lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-4d9421e8-0095-4da9-995f-dba02a5c0c70 req-1c196cbd-ed2d-46d7-b25b-df13f71c28bb service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Refreshing network info cache for port a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Successfully updated port: 23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquired lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-dda16a3d-f230-491e-857b-43a83d6178bc req-54ede5b7-d62e-40b9-a49c-bd7259182e5c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-changed-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-dda16a3d-f230-491e-857b-43a83d6178bc req-54ede5b7-d62e-40b9-a49c-bd7259182e5c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Refreshing instance network info cache due to event network-changed-23a82f81-d0bf-420c-a9f9-e8241d7524c5. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dda16a3d-f230-491e-857b-43a83d6178bc req-54ede5b7-d62e-40b9-a49c-bd7259182e5c service nova] Acquiring lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-4d9421e8-0095-4da9-995f-dba02a5c0c70 req-1c196cbd-ed2d-46d7-b25b-df13f71c28bb service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updated VIF entry in instance network info cache for port a4d4380d-a5c8-4a18-8255-7e256cc7c3f1. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-4d9421e8-0095-4da9-995f-dba02a5c0c70 req-1c196cbd-ed2d-46d7-b25b-df13f71c28bb service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating instance_info_cache with network_info: [{"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4d9421e8-0095-4da9-995f-dba02a5c0c70 req-1c196cbd-ed2d-46d7-b25b-df13f71c28bb service nova] Releasing lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Updating instance_info_cache with network_info: [{"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Releasing lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Instance network_info: |[{"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dda16a3d-f230-491e-857b-43a83d6178bc req-54ede5b7-d62e-40b9-a49c-bd7259182e5c service nova] Acquired lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-dda16a3d-f230-491e-857b-43a83d6178bc req-54ede5b7-d62e-40b9-a49c-bd7259182e5c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Refreshing network info cache for port 23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-dda16a3d-f230-491e-857b-43a83d6178bc req-54ede5b7-d62e-40b9-a49c-bd7259182e5c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Updated VIF entry in instance network info cache for port 23a82f81-d0bf-420c-a9f9-e8241d7524c5. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:00:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-dda16a3d-f230-491e-857b-43a83d6178bc req-54ede5b7-d62e-40b9-a49c-bd7259182e5c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Updating instance_info_cache with network_info: [{"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:00:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dda16a3d-f230-491e-857b-43a83d6178bc req-54ede5b7-d62e-40b9-a49c-bd7259182e5c service nova] Releasing lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:00:52 user nova-compute[76161]: INFO nova.compute.manager [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Rescuing
Nov 14 18:00:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:00:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquired lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:00:52 user nova-compute[76161]: DEBUG nova.network.neutron [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG nova.network.neutron [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Updating instance_info_cache with network_info: [{"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Releasing lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-71eb6b47-6301-45fa-ae83-2b792fa0db7a req-16b6d7de-81a8-4b31-88ad-1382369aa87a service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-unplugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-71eb6b47-6301-45fa-ae83-2b792fa0db7a req-16b6d7de-81a8-4b31-88ad-1382369aa87a service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-71eb6b47-6301-45fa-ae83-2b792fa0db7a req-16b6d7de-81a8-4b31-88ad-1382369aa87a service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-71eb6b47-6301-45fa-ae83-2b792fa0db7a req-16b6d7de-81a8-4b31-88ad-1382369aa87a service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-71eb6b47-6301-45fa-ae83-2b792fa0db7a req-16b6d7de-81a8-4b31-88ad-1382369aa87a service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-unplugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:53 user nova-compute[76161]: WARNING nova.compute.manager [req-71eb6b47-6301-45fa-ae83-2b792fa0db7a req-16b6d7de-81a8-4b31-88ad-1382369aa87a service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-unplugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state active and task_state rescuing.
Nov 14 18:00:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Instance destroyed successfully.
Nov 14 18:00:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Attempting rescue
Nov 14 18:00:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76161) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Instance directory exists: not creating {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 18:00:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Creating image(s)
Nov 14 18:00:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'trusted_certs' on Instance uuid de90c284-3d97-42c6-9692-cdac8eccd2ef {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue" returned: 0 in 0.064s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'migration_context' on Instance uuid de90c284-3d97-42c6-9692-cdac8eccd2ef {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.objects.base [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<de90c284-3d97-42c6-9692-cdac8eccd2ef> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Start _get_guest_xml network_info=[{"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "vif_mac": "fa:16:3e:9c:eb:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'resources' on Instance uuid de90c284-3d97-42c6-9692-cdac8eccd2ef {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.objects.base [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<de90c284-3d97-42c6-9692-cdac8eccd2ef> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'numa_topology' on Instance uuid de90c284-3d97-42c6-9692-cdac8eccd2ef {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.objects.base [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<de90c284-3d97-42c6-9692-cdac8eccd2ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:00:54 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:00:54 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'vcpu_model' on Instance uuid de90c284-3d97-42c6-9692-cdac8eccd2ef {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.objects.base [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<de90c284-3d97-42c6-9692-cdac8eccd2ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296589707',display_name='tempest-ServerRescueNegativeTestJSON-server-296589707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296589707',id=31,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-hz0wi1so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:13Z,user_data=None,user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=de90c284-3d97-42c6-9692-cdac8eccd2ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "vif_mac": "fa:16:3e:9c:eb:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "vif_mac": "fa:16:3e:9c:eb:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:eb:17,bridge_name='br-int',has_traffic_filtering=True,id=ec07d878-8c19-4c35-bc46-ba1bf514cf60,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec07d878-8c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'pci_devices' on Instance uuid de90c284-3d97-42c6-9692-cdac8eccd2ef {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.objects.base [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<de90c284-3d97-42c6-9692-cdac8eccd2ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:00:54 user nova-compute[76161]:   <uuid>de90c284-3d97-42c6-9692-cdac8eccd2ef</uuid>
Nov 14 18:00:54 user nova-compute[76161]:   <name>instance-0000001f</name>
Nov 14 18:00:54 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:00:54 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:00:54 user nova-compute[76161]:   <metadata>
Nov 14 18:00:54 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:00:54 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:00:54 user nova-compute[76161]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-296589707</nova:name>
Nov 14 18:00:54 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:00:54</nova:creationTime>
Nov 14 18:00:54 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:00:54 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:00:54 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:00:54 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:00:54 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:00:54 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:00:54 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:00:54 user nova-compute[76161]:       <nova:owner>
Nov 14 18:00:54 user nova-compute[76161]:         <nova:user uuid="d463f3fddeba4976bded6ba5abc6c98c">tempest-ServerRescueNegativeTestJSON-1787067728-project-member</nova:user>
Nov 14 18:00:54 user nova-compute[76161]:         <nova:project uuid="952a823fe4e04963916979f78d5c82a7">tempest-ServerRescueNegativeTestJSON-1787067728</nova:project>
Nov 14 18:00:54 user nova-compute[76161]:       </nova:owner>
Nov 14 18:00:54 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:00:54 user nova-compute[76161]:       <nova:ports>
Nov 14 18:00:54 user nova-compute[76161]:         <nova:port uuid="ec07d878-8c19-4c35-bc46-ba1bf514cf60">
Nov 14 18:00:54 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 18:00:54 user nova-compute[76161]:         </nova:port>
Nov 14 18:00:54 user nova-compute[76161]:       </nova:ports>
Nov 14 18:00:54 user nova-compute[76161]:     </nova:instance>
Nov 14 18:00:54 user nova-compute[76161]:   </metadata>
Nov 14 18:00:54 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:00:54 user nova-compute[76161]:     <system>
Nov 14 18:00:54 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:00:54 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:00:54 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:00:54 user nova-compute[76161]:       <entry name="serial">de90c284-3d97-42c6-9692-cdac8eccd2ef</entry>
Nov 14 18:00:54 user nova-compute[76161]:       <entry name="uuid">de90c284-3d97-42c6-9692-cdac8eccd2ef</entry>
Nov 14 18:00:54 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:00:54 user nova-compute[76161]:     </system>
Nov 14 18:00:54 user nova-compute[76161]:   </sysinfo>
Nov 14 18:00:54 user nova-compute[76161]:   <os>
Nov 14 18:00:54 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:00:54 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:00:54 user nova-compute[76161]:   </os>
Nov 14 18:00:54 user nova-compute[76161]:   <features>
Nov 14 18:00:54 user nova-compute[76161]:     <acpi/>
Nov 14 18:00:54 user nova-compute[76161]:     <apic/>
Nov 14 18:00:54 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:00:54 user nova-compute[76161]:   </features>
Nov 14 18:00:54 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:00:54 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:00:54 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:00:54 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:00:54 user nova-compute[76161]:   </clock>
Nov 14 18:00:54 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:00:54 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:00:54 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:00:54 user nova-compute[76161]:   </cpu>
Nov 14 18:00:54 user nova-compute[76161]:   <devices>
Nov 14 18:00:54 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:00:54 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:00:54 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue"/>
Nov 14 18:00:54 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:00:54 user nova-compute[76161]:     </disk>
Nov 14 18:00:54 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:00:54 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:00:54 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk"/>
Nov 14 18:00:54 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 18:00:54 user nova-compute[76161]:     </disk>
Nov 14 18:00:54 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:00:54 user nova-compute[76161]:       <mac address="fa:16:3e:9c:eb:17"/>
Nov 14 18:00:54 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:00:54 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:00:54 user nova-compute[76161]:       <target dev="tapec07d878-8c"/>
Nov 14 18:00:54 user nova-compute[76161]:     </interface>
Nov 14 18:00:54 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:00:54 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/console.log" append="off"/>
Nov 14 18:00:54 user nova-compute[76161]:     </serial>
Nov 14 18:00:54 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:00:54 user nova-compute[76161]:     <video>
Nov 14 18:00:54 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:00:54 user nova-compute[76161]:     </video>
Nov 14 18:00:54 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:00:54 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:00:54 user nova-compute[76161]:     </rng>
Nov 14 18:00:54 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:00:54 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:00:54 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:00:54 user nova-compute[76161]:     </memballoon>
Nov 14 18:00:54 user nova-compute[76161]:   </devices>
Nov 14 18:00:54 user nova-compute[76161]: </domain>
Nov 14 18:00:54 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:00:54 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Instance destroyed successfully.
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No VIF found with MAC fa:16:3e:9c:eb:17, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-692250ed-7742-4c26-9185-62904fefa61e req-a42d889e-e743-44f4-a198-115ec32929a1 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-changed-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-692250ed-7742-4c26-9185-62904fefa61e req-a42d889e-e743-44f4-a198-115ec32929a1 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Refreshing instance network info cache due to event network-changed-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-692250ed-7742-4c26-9185-62904fefa61e req-a42d889e-e743-44f4-a198-115ec32929a1 service nova] Acquiring lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-692250ed-7742-4c26-9185-62904fefa61e req-a42d889e-e743-44f4-a198-115ec32929a1 service nova] Acquired lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-692250ed-7742-4c26-9185-62904fefa61e req-a42d889e-e743-44f4-a198-115ec32929a1 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Refreshing network info cache for port 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-49c0a404-e6ef-44ed-8892-3063b730bb67 req-d269437c-05f0-4f54-8715-7ef373aacee9 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received event network-changed-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-49c0a404-e6ef-44ed-8892-3063b730bb67 req-d269437c-05f0-4f54-8715-7ef373aacee9 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Refreshing instance network info cache due to event network-changed-1b5e3434-bed5-4f47-8004-ed361e773df0. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-49c0a404-e6ef-44ed-8892-3063b730bb67 req-d269437c-05f0-4f54-8715-7ef373aacee9 service nova] Acquiring lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-49c0a404-e6ef-44ed-8892-3063b730bb67 req-d269437c-05f0-4f54-8715-7ef373aacee9 service nova] Acquired lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-49c0a404-e6ef-44ed-8892-3063b730bb67 req-d269437c-05f0-4f54-8715-7ef373aacee9 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Refreshing network info cache for port 1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:00:54 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Creating image(s)
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Ensure instance console log exists: /opt/stack/data/nova/instances/a0a5d3ce-4564-434d-9650-36548fb33ab0/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Start _get_guest_xml network_info=[{"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmKOogtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a0a5d3ce-4564-434d-9650-36548fb33ab0', 'attached_at': '', 'detached_at': '', 'volume_id': '6101ad26-b308-4342-b713-180af5bf40fe', 'serial': '6101ad26-b308-4342-b713-180af5bf40fe'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '2f9f7814-1596-48fa-91ee-56fee0f72832', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:00:54 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:00:54 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmKOogtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:00:54 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:00:54 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:00:54 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4e3034-3a75-4c4d-908c-9ebfa6f276aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:00:54 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:54 user nova-compute[76161]: INFO nova.compute.manager [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Terminating instance
Nov 14 18:00:54 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7fffef-b6d9-40ae-a4cb-1dc814f8ac5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe] added
Nov 14 18:00:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[025be3a1-40a9-4491-92bc-22a7fb98f32f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b998d-d471-45a1-a593-daf26b0283e2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rmKOogtc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rmKOogtc" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adfc3cb-7c89-4cd5-8da2-768423c1d054]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rmKOogtc'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fd01bb-109c-465b-9073-560bd2d0938f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dade0fdc-0ad0-46a3-b441-86342fe30df2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:54 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:54 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:54 user nova-compute[76161]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)
Nov 14 18:00:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:54 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:54 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:54 user nova-compute[76161]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)
Nov 14 18:00:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --login" returned: 0 in 0.122s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a80f4a2-5c0e-488b-b86b-04483237ff29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260]
Nov 14 18:00:55 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260] successful.
Nov 14 18:00:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d816d406-b48c-4d2e-9e4f-2a9cc21113f3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ba834-0a82-46ba-b3aa-14dfa64af5a2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:55 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:55 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:55 user nova-compute[76161]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)
Nov 14 18:00:55 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:00:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:55 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:55 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:55 user nova-compute[76161]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)
Nov 14 18:00:55 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:00:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37b4709-b3ac-459c-b7c5-8ac2e6e79c8a]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmKOogtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG nova.network.neutron [req-692250ed-7742-4c26-9185-62904fefa61e req-a42d889e-e743-44f4-a198-115ec32929a1 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updated VIF entry in instance network info cache for port 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG nova.network.neutron [req-692250ed-7742-4c26-9185-62904fefa61e req-a42d889e-e743-44f4-a198-115ec32929a1 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updating instance_info_cache with network_info: [{"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-692250ed-7742-4c26-9185-62904fefa61e req-a42d889e-e743-44f4-a198-115ec32929a1 service nova] Releasing lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG nova.network.neutron [req-49c0a404-e6ef-44ed-8892-3063b730bb67 req-d269437c-05f0-4f54-8715-7ef373aacee9 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Updated VIF entry in instance network info cache for port 1b5e3434-bed5-4f47-8004-ed361e773df0. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG nova.network.neutron [req-49c0a404-e6ef-44ed-8892-3063b730bb67 req-d269437c-05f0-4f54-8715-7ef373aacee9 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Updating instance_info_cache with network_info: [{"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-49c0a404-e6ef-44ed-8892-3063b730bb67 req-d269437c-05f0-4f54-8715-7ef373aacee9 service nova] Releasing lock "refresh_cache-2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:55 user nova-compute[76161]: WARNING nova.compute.manager [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state active and task_state rescuing.
Nov 14 18:00:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received event network-vif-unplugged-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] Acquiring lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] No waiting events found dispatching network-vif-unplugged-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-23e3b4b3-27d1-4812-8ddf-578244fa893c req-2477ac9d-db1c-41f9-b97c-9cd5f2ad8841 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received event network-vif-unplugged-1b5e3434-bed5-4f47-8004-ed361e773df0 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.utils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a0bef4-dc69-4d71-9d52-45312a57b03d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3cebab-dddc-4fcd-844f-a4c344643f5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2bbdc2-1eb8-4b8b-beca-1210be15e9f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d956a9e6-518e-4efd-9b99-3bf14373f42f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:00:55 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:00:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[22890e24-22c9-461d-9182-666b695099f2]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG os_brick.utils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:00:55 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Updating existing volume attachment record: f6a1c450-6bc1-4609-923d-c9c9fd3edd60 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:00:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Instance destroyed successfully.
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.objects.instance [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lazy-loading 'resources' on Instance uuid 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:58:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2071279675',display_name='tempest-TestStampPattern-server-2071279675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2071279675',id=29,image_ref='e9d20e5a-73d6-4594-a67f-86797c646768',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVn++uY914nMT4ppedFhS8d3dW25Wn2Uz3D0CtpuFA7uYKjt5LP3wVNJBoX8K7AIEJk32VFPhZsLSf9W5T1bKCgwU7sl5Ok2efZd0OuAxtFgTYFlNfvMQAY6AUQQc/vkg==',key_name='tempest-TestStampPattern-1685336557',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:58:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b72de616ddd04286a9946e5727b76e85',ramdisk_id='',reservation_id='r-03prqqxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6e87b617-e12f-4c33-bd5d-8f1bc07c417b',image_min_disk='1',image_min_ram='0',image_owner_id='b72de616ddd04286a9946e5727b76e85',image_owner_project_name='tempest-TestStampPattern-1566874307',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1566874307-project-member',image_user_id='220334ba1c7744c68e1bd8c2c5c20749',owner_project_name='tempest-TestStampPattern-1566874307',owner_user_name='tempest-TestStampPattern-1566874307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:58:10Z,user_data=None,user_id='220334ba1c7744c68e1bd8c2c5c20749',uuid=2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converting VIF {"id": "1b5e3434-bed5-4f47-8004-ed361e773df0", "address": "fa:16:3e:7c:c2:3a", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b5e3434-be", "ovs_interfaceid": "1b5e3434-bed5-4f47-8004-ed361e773df0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=1b5e3434-bed5-4f47-8004-ed361e773df0,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5e3434-be') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_vif [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=1b5e3434-bed5-4f47-8004-ed361e773df0,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5e3434-be') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b5e3434-be, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b58c262-9ab4-4387-bd13-3c20a0f1de0b) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: INFO os_vif [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:c2:3a,bridge_name='br-int',has_traffic_filtering=True,id=1b5e3434-bed5-4f47-8004-ed361e773df0,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b5e3434-be')
Nov 14 18:00:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Deleting instance files /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d_del
Nov 14 18:00:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Deletion of /opt/stack/data/nova/instances/2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d_del complete
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23534346133623238', 'path': '/dev/sdf'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534346133623238', 'path': '/dev/sdf'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-927479785',display_name='tempest-ServerActionsTestOtherA-server-927479785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-927479785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/qLMrSixUeoWRNqyyMAmkr6Jdv4puUPBA23tnedByCcFoj2iOZE+ZPEXsuKk/6jLGW1AaCT9PLvxK/WjfaizeZDXI/isTmP1fIOMxcZKPA16ZEa+3fb0iod0Nl+OKmuw==',key_name='tempest-keypair-197899952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-8sb5sxna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=a0a5d3ce-4564-434d-9650-36548fb33ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'pci_devices' on Instance uuid a0a5d3ce-4564-434d-9650-36548fb33ab0 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:00:56 user nova-compute[76161]:   <uuid>a0a5d3ce-4564-434d-9650-36548fb33ab0</uuid>
Nov 14 18:00:56 user nova-compute[76161]:   <name>instance-00000023</name>
Nov 14 18:00:56 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:00:56 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:00:56 user nova-compute[76161]:   <metadata>
Nov 14 18:00:56 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:00:56 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:00:56 user nova-compute[76161]:       <nova:name>tempest-ServerActionsTestOtherA-server-927479785</nova:name>
Nov 14 18:00:56 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:00:54</nova:creationTime>
Nov 14 18:00:56 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:00:56 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:00:56 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:00:56 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:00:56 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:00:56 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:00:56 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:00:56 user nova-compute[76161]:       <nova:owner>
Nov 14 18:00:56 user nova-compute[76161]:         <nova:user uuid="bbfeb35beb394e15bf881780f69724f6">tempest-ServerActionsTestOtherA-233736107-project-member</nova:user>
Nov 14 18:00:56 user nova-compute[76161]:         <nova:project uuid="4467aca672a34c1a8f4e1735636d311b">tempest-ServerActionsTestOtherA-233736107</nova:project>
Nov 14 18:00:56 user nova-compute[76161]:       </nova:owner>
Nov 14 18:00:56 user nova-compute[76161]:       <nova:ports>
Nov 14 18:00:56 user nova-compute[76161]:         <nova:port uuid="a4d4380d-a5c8-4a18-8255-7e256cc7c3f1">
Nov 14 18:00:56 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 18:00:56 user nova-compute[76161]:         </nova:port>
Nov 14 18:00:56 user nova-compute[76161]:       </nova:ports>
Nov 14 18:00:56 user nova-compute[76161]:     </nova:instance>
Nov 14 18:00:56 user nova-compute[76161]:   </metadata>
Nov 14 18:00:56 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:00:56 user nova-compute[76161]:     <system>
Nov 14 18:00:56 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:00:56 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:00:56 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:00:56 user nova-compute[76161]:       <entry name="serial">a0a5d3ce-4564-434d-9650-36548fb33ab0</entry>
Nov 14 18:00:56 user nova-compute[76161]:       <entry name="uuid">a0a5d3ce-4564-434d-9650-36548fb33ab0</entry>
Nov 14 18:00:56 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:00:56 user nova-compute[76161]:     </system>
Nov 14 18:00:56 user nova-compute[76161]:   </sysinfo>
Nov 14 18:00:56 user nova-compute[76161]:   <os>
Nov 14 18:00:56 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:00:56 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:00:56 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:00:56 user nova-compute[76161]:   </os>
Nov 14 18:00:56 user nova-compute[76161]:   <features>
Nov 14 18:00:56 user nova-compute[76161]:     <acpi/>
Nov 14 18:00:56 user nova-compute[76161]:     <apic/>
Nov 14 18:00:56 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:00:56 user nova-compute[76161]:   </features>
Nov 14 18:00:56 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:00:56 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:00:56 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:00:56 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:00:56 user nova-compute[76161]:   </clock>
Nov 14 18:00:56 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:00:56 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:00:56 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:00:56 user nova-compute[76161]:   </cpu>
Nov 14 18:00:56 user nova-compute[76161]:   <devices>
Nov 14 18:00:56 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:00:56 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:00:56 user nova-compute[76161]:       <source dev="/dev/sdf"/>
Nov 14 18:00:56 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:00:56 user nova-compute[76161]:       <serial>6101ad26-b308-4342-b713-180af5bf40fe</serial>
Nov 14 18:00:56 user nova-compute[76161]:     </disk>
Nov 14 18:00:56 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:00:56 user nova-compute[76161]:       <mac address="fa:16:3e:4a:e7:94"/>
Nov 14 18:00:56 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:00:56 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:00:56 user nova-compute[76161]:       <target dev="tapa4d4380d-a5"/>
Nov 14 18:00:56 user nova-compute[76161]:     </interface>
Nov 14 18:00:56 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:00:56 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/a0a5d3ce-4564-434d-9650-36548fb33ab0/console.log" append="off"/>
Nov 14 18:00:56 user nova-compute[76161]:     </serial>
Nov 14 18:00:56 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:00:56 user nova-compute[76161]:     <video>
Nov 14 18:00:56 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:00:56 user nova-compute[76161]:     </video>
Nov 14 18:00:56 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:00:56 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:00:56 user nova-compute[76161]:     </rng>
Nov 14 18:00:56 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:00:56 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:00:56 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:00:56 user nova-compute[76161]:     </memballoon>
Nov 14 18:00:56 user nova-compute[76161]:   </devices>
Nov 14 18:00:56 user nova-compute[76161]: </domain>
Nov 14 18:00:56 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-927479785',display_name='tempest-ServerActionsTestOtherA-server-927479785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-927479785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/qLMrSixUeoWRNqyyMAmkr6Jdv4puUPBA23tnedByCcFoj2iOZE+ZPEXsuKk/6jLGW1AaCT9PLvxK/WjfaizeZDXI/isTmP1fIOMxcZKPA16ZEa+3fb0iod0Nl+OKmuw==',key_name='tempest-keypair-197899952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-8sb5sxna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=a0a5d3ce-4564-434d-9650-36548fb33ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_vif [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '996fb984-8428-5b47-8640-d3897f190542', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:00:56 user nova-compute[76161]: INFO nova.compute.manager [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4d4380d-a5, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4d4380d-a5, col_values=(('qos', UUID('cc1a5854-5e87-4d18-bc9c-fa036026721a')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4d4380d-a5, col_values=(('external_ids', {'iface-id': 'a4d4380d-a5c8-4a18-8255-7e256cc7c3f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:e7:94', 'vm-uuid': 'a0a5d3ce-4564-434d-9650-36548fb33ab0'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: INFO os_vif [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5')
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No VIF found with MAC fa:16:3e:4a:e7:94, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:56 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 is timed out.
Nov 14 18:00:56 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Successfully detached device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the live domain config.
Nov 14 18:00:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEdLDiKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:00:56 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5738f19b-b55a-42fa-b343-f53b6e5c7cf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:00:56 user nova-compute[76161]: No targets found.
Nov 14 18:00:56 user nova-compute[76161]: iSNS:
Nov 14 18:00:56 user nova-compute[76161]: No targets found.
Nov 14 18:00:56 user nova-compute[76161]: STATIC:
Nov 14 18:00:56 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1
Nov 14 18:00:56 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:56 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:56 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:00:56 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:56 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:56 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:00:56 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:56 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:56 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752
Nov 14 18:00:56 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:56 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:56 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:00:56 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:00:56 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:00:56 user nova-compute[76161]: FIRMWARE:
Nov 14 18:00:56 user nova-compute[76161]: No targets found.
Nov 14 18:00:56 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:00:56 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:00:56 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abad0c0-f815-44e8-8e15-44811959430d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1d7304-2c7a-41c8-a378-71aedcf698eb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:56 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:56 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:56 user nova-compute[76161]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)
Nov 14 18:00:56 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:00:56 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:00:56 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:00:56 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:00:56 user nova-compute[76161]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 (non-flash)
Nov 14 18:00:56 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:00:56 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f02832e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[763af63f-f4a8-45f8-bde2-91e04d815fa2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c2f807-ccb4-434f-a883-3d922b206e8b]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a0387a-d7cd-4ac2-b607-45da17c889f2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[022fd179-ca7b-42ed-a3d8-b6d795208cd0]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:56 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0674162-f643-402d-a99b-10f760cdc9f9]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[94280a90-a8de-478f-9c3c-3582a58f60ec]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1, portal: 172.16.0.220,3260]
Nov 14 18:00:57 user nova-compute[76161]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1, portal: 172.16.0.220,3260] successful.
Nov 14 18:00:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0748ea33-447f-4d27-b5ee-085a7e285cb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c95d14-3043-41cf-80fb-c5d5d62b49db]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== disconnect_volume: return (387ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:00:57 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Took 1.04 seconds to deallocate network for instance.
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:57 user nova-compute[76161]: INFO nova.compute.manager [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Shelving
Nov 14 18:00:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received event network-vif-plugged-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] Acquiring lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] No waiting events found dispatching network-vif-plugged-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:57 user nova-compute[76161]: WARNING nova.compute.manager [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received unexpected event network-vif-plugged-1b5e3434-bed5-4f47-8004-ed361e773df0 for instance with vm_state deleted and task_state None.
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:57 user nova-compute[76161]: WARNING nova.compute.manager [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state active and task_state rescuing.
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:57 user nova-compute[76161]: WARNING nova.compute.manager [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state active and task_state rescuing.
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-5af2c8b9-c448-4e52-9729-0955c173784a req-fa3b0732-f3cb-4f3a-9fdc-7c70ae1f8653 service nova] [instance: 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d] Received event network-vif-deleted-1b5e3434-bed5-4f47-8004-ed361e773df0 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-714560ae-ceed-41f6-b824-3f90888c0896 req-e22449ff-0ead-4ef1-bbf6-bb055ec05d9d service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-vif-unplugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-714560ae-ceed-41f6-b824-3f90888c0896 req-e22449ff-0ead-4ef1-bbf6-bb055ec05d9d service nova] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-714560ae-ceed-41f6-b824-3f90888c0896 req-e22449ff-0ead-4ef1-bbf6-bb055ec05d9d service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-714560ae-ceed-41f6-b824-3f90888c0896 req-e22449ff-0ead-4ef1-bbf6-bb055ec05d9d service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.compute.manager [req-714560ae-ceed-41f6-b824-3f90888c0896 req-e22449ff-0ead-4ef1-bbf6-bb055ec05d9d service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] No waiting events found dispatching network-vif-unplugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:57 user nova-compute[76161]: WARNING nova.compute.manager [req-714560ae-ceed-41f6-b824-3f90888c0896 req-e22449ff-0ead-4ef1-bbf6-bb055ec05d9d service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received unexpected event network-vif-unplugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 for instance with vm_state active and task_state shelving.
Nov 14 18:00:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:00:57 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:00:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.677s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:58 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Deleted allocations for instance 2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d
Nov 14 18:00:58 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:00:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:00:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-04aea4aa-0798-4c73-8672-0346eb994829 req-a1320b12-f2ca-450c-bbd5-ce3c1444eb7d service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-04aea4aa-0798-4c73-8672-0346eb994829 req-a1320b12-f2ca-450c-bbd5-ce3c1444eb7d service nova] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-04aea4aa-0798-4c73-8672-0346eb994829 req-a1320b12-f2ca-450c-bbd5-ce3c1444eb7d service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-04aea4aa-0798-4c73-8672-0346eb994829 req-a1320b12-f2ca-450c-bbd5-ce3c1444eb7d service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-04aea4aa-0798-4c73-8672-0346eb994829 req-a1320b12-f2ca-450c-bbd5-ce3c1444eb7d service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] No waiting events found dispatching network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:58 user nova-compute[76161]: WARNING nova.compute.manager [req-04aea4aa-0798-4c73-8672-0346eb994829 req-a1320b12-f2ca-450c-bbd5-ce3c1444eb7d service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received unexpected event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 for instance with vm_state building and task_state spawning.
Nov 14 18:00:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ac631ce-53f7-4dae-85a7-754104947b18 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.132s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b56a08ac-20e8-40b1-a222-df89f5b7c055 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "2daaebdb-cb4e-4dcf-af32-ecdd74aeed1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.573s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Instance destroyed successfully.
Nov 14 18:00:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Beginning cold snapshot process
Nov 14 18:00:58 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 18:00:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk /opt/stack/data/nova/instances/snapshots/tmpw01uj6jc/22950c4ea0ac47f2a62f38058e1cd818 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:00:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk /opt/stack/data/nova/instances/snapshots/tmpw01uj6jc/22950c4ea0ac47f2a62f38058e1cd818" returned: 0 in 0.707s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:00:59 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Snapshot extracted, beginning image upload
Nov 14 18:00:59 user nova-compute[76161]: DEBUG nova.compute.manager [None req-bc203214-f3b8-492c-8869-67d447b1fbe4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:00:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-14e2d47b-2bff-4ac5-bf3b-3cd1aa53e8a1 req-445f914b-8eec-4930-bbe3-72950027f7e8 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:00:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-14e2d47b-2bff-4ac5-bf3b-3cd1aa53e8a1 req-445f914b-8eec-4930-bbe3-72950027f7e8 service nova] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:00:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-14e2d47b-2bff-4ac5-bf3b-3cd1aa53e8a1 req-445f914b-8eec-4930-bbe3-72950027f7e8 service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:00:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-14e2d47b-2bff-4ac5-bf3b-3cd1aa53e8a1 req-445f914b-8eec-4930-bbe3-72950027f7e8 service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:00:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-14e2d47b-2bff-4ac5-bf3b-3cd1aa53e8a1 req-445f914b-8eec-4930-bbe3-72950027f7e8 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] No waiting events found dispatching network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:00:59 user nova-compute[76161]: WARNING nova.compute.manager [req-14e2d47b-2bff-4ac5-bf3b-3cd1aa53e8a1 req-445f914b-8eec-4930-bbe3-72950027f7e8 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received unexpected event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 18:01:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-f279532a-5407-495a-9a22-e0eb78863393 req-fbfa4b2d-f785-4032-b3cd-a1a1c970dc10 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f279532a-5407-495a-9a22-e0eb78863393 req-fbfa4b2d-f785-4032-b3cd-a1a1c970dc10 service nova] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f279532a-5407-495a-9a22-e0eb78863393 req-fbfa4b2d-f785-4032-b3cd-a1a1c970dc10 service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f279532a-5407-495a-9a22-e0eb78863393 req-fbfa4b2d-f785-4032-b3cd-a1a1c970dc10 service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-f279532a-5407-495a-9a22-e0eb78863393 req-fbfa4b2d-f785-4032-b3cd-a1a1c970dc10 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] No waiting events found dispatching network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:00 user nova-compute[76161]: WARNING nova.compute.manager [req-f279532a-5407-495a-9a22-e0eb78863393 req-fbfa4b2d-f785-4032-b3cd-a1a1c970dc10 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received unexpected event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 for instance with vm_state building and task_state spawning.
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:01:00 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Instance spawned successfully.
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:00 user nova-compute[76161]: INFO nova.compute.manager [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 14 18:01:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:01:00 user nova-compute[76161]: INFO nova.compute.manager [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Took 12.46 seconds to build instance.
Nov 14 18:01:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2f505d91-8741-42e0-9dda-f1ddd3eeeea2 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.574s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.compute.manager [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:01:01 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Creating image(s)
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Ensure instance console log exists: /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Start _get_guest_xml network_info=[{"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHKLVvmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd162511-a09b-4479-8d29-0a5a4b40ae78', 'attached_at': '', 'detached_at': '', 'volume_id': '80815466-0bc1-43dd-8a76-979ef49da369', 'serial': '80815466-0bc1-43dd-8a76-979ef49da369'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'f6a1c450-6bc1-4609-923d-c9c9fd3edd60', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:01:01 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:01:01 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHKLVvmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:01 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:01 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:01 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8052dc1-79c1-424d-a030-f4dac1fc3f0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:01:01 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6113d7d-6267-4a57-bfcd-6ed6c3bea990]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369] added
Nov 14 18:01:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c0304c-5082-4f51-8663-24ab837dfc6e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbab924d-3cc7-4991-a525-c64d6d2b9393]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHKLVvmz {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHKLVvmz" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[758b05c6-ce94-4220-b03d-46822623d779]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHKLVvmz'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dfc0b8-86d7-4a25-9bf6-0075736a48d2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1b21a8-87ce-4b27-a49b-58e5db15c90b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2865e3c-fbc9-4546-839e-af615cf5aa9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369, portal: 172.16.0.220,3260]
Nov 14 18:01:01 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369, portal: 172.16.0.220,3260] successful.
Nov 14 18:01:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aff075-4e70-4e1d-bf4a-2584a49688fd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquired lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'info_cache' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4daf690-e81a-47f5-ba29-56ea27f5af98]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:01 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd0dd5-0a1f-4d90-a2f3-bd9e73c93ebb]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.objects.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:01:01 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 952593b7-cc8b-4d50-8aa8-a50e385e088b is timed out.
Nov 14 18:01:01 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Successfully detached device vdb from instance 952593b7-cc8b-4d50-8aa8-a50e385e088b from the live domain config.
Nov 14 18:01:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTuielRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:01 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updating instance_info_cache with network_info: [{"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Releasing lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:01:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance destroyed successfully.
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'resources' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.objects.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1792224443',display_name='tempest-AttachVolumeTestJSON-server-1792224443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1792224443',id=24,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwTHCRRw1KxJLD9CcCs2gIwosvX+o4FaLgfSFYOuEANvq2aIipEcsGq1NHxa+NHKqWzzuxELOvKadsYZSKZeiQ7BOeCDXZ3VUvf4hvZmX1n4PdafIxgOfEgrSs9aoeq3Q==',key_name='tempest-keypair-1778122280',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-iw0i0sws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=75295499-8f99-4c9b-a556-c1287c61d8f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_vif [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9c3c5f8-f7, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0416e2d-e690-420f-8276-e09864b34cde) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: INFO os_vif [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7')
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQzrRHBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:02 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Snapshot image upload complete
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHKLVvmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23664633035326539', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664633035326539', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.923s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-431593191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-431593191',id=36,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-630lejpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:00:50Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=cd162511-a09b-4479-8d29-0a5a4b40ae78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:16,bridge_name='br-int',has_traffic_filtering=True,id=23a82f81-d0bf-420c-a9f9-e8241d7524c5,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a82f81-d0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.objects.instance [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'pci_devices' on Instance uuid cd162511-a09b-4479-8d29-0a5a4b40ae78 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0099c873-3e91-4336-b954-ae29ff3ca119]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:01:02 user nova-compute[76161]: No targets found.
Nov 14 18:01:02 user nova-compute[76161]: iSNS:
Nov 14 18:01:02 user nova-compute[76161]: No targets found.
Nov 14 18:01:02 user nova-compute[76161]: STATIC:
Nov 14 18:01:02 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:01:02 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:02 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:02 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:01:02 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:02 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:02 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:01:02 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:02 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:02 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752
Nov 14 18:01:02 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:02 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:02 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:01:02 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:02 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:02 user nova-compute[76161]: FIRMWARE:
Nov 14 18:01:02 user nova-compute[76161]: No targets found.
Nov 14 18:01:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:01:02 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:01:02 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:01:02 user nova-compute[76161]:   <uuid>cd162511-a09b-4479-8d29-0a5a4b40ae78</uuid>
Nov 14 18:01:02 user nova-compute[76161]:   <name>instance-00000024</name>
Nov 14 18:01:02 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:01:02 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:01:02 user nova-compute[76161]:   <metadata>
Nov 14 18:01:02 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:01:02 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:01:02 user nova-compute[76161]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-431593191</nova:name>
Nov 14 18:01:02 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:01:01</nova:creationTime>
Nov 14 18:01:02 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:01:02 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:01:02 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:01:02 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:01:02 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:01:02 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:01:02 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:01:02 user nova-compute[76161]:       <nova:owner>
Nov 14 18:01:02 user nova-compute[76161]:         <nova:user uuid="4714975d06d8455788463a30e9bc5faa">tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member</nova:user>
Nov 14 18:01:02 user nova-compute[76161]:         <nova:project uuid="69696059b86f44b7ae274bf8274f9843">tempest-ServerBootFromVolumeStableRescueTest-500586355</nova:project>
Nov 14 18:01:02 user nova-compute[76161]:       </nova:owner>
Nov 14 18:01:02 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:01:02 user nova-compute[76161]:       <nova:ports>
Nov 14 18:01:02 user nova-compute[76161]:         <nova:port uuid="23a82f81-d0bf-420c-a9f9-e8241d7524c5">
Nov 14 18:01:02 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 18:01:02 user nova-compute[76161]:         </nova:port>
Nov 14 18:01:02 user nova-compute[76161]:       </nova:ports>
Nov 14 18:01:02 user nova-compute[76161]:     </nova:instance>
Nov 14 18:01:02 user nova-compute[76161]:   </metadata>
Nov 14 18:01:02 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:01:02 user nova-compute[76161]:     <system>
Nov 14 18:01:02 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:01:02 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:01:02 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:01:02 user nova-compute[76161]:       <entry name="serial">cd162511-a09b-4479-8d29-0a5a4b40ae78</entry>
Nov 14 18:01:02 user nova-compute[76161]:       <entry name="uuid">cd162511-a09b-4479-8d29-0a5a4b40ae78</entry>
Nov 14 18:01:02 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:01:02 user nova-compute[76161]:     </system>
Nov 14 18:01:02 user nova-compute[76161]:   </sysinfo>
Nov 14 18:01:02 user nova-compute[76161]:   <os>
Nov 14 18:01:02 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:01:02 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:01:02 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:01:02 user nova-compute[76161]:   </os>
Nov 14 18:01:02 user nova-compute[76161]:   <features>
Nov 14 18:01:02 user nova-compute[76161]:     <acpi/>
Nov 14 18:01:02 user nova-compute[76161]:     <apic/>
Nov 14 18:01:02 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:01:02 user nova-compute[76161]:   </features>
Nov 14 18:01:02 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:01:02 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:01:02 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:01:02 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:01:02 user nova-compute[76161]:   </clock>
Nov 14 18:01:02 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:01:02 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:01:02 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:01:02 user nova-compute[76161]:   </cpu>
Nov 14 18:01:02 user nova-compute[76161]:   <devices>
Nov 14 18:01:02 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:01:02 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:02 user nova-compute[76161]:       <source dev="/dev/sdc"/>
Nov 14 18:01:02 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:01:02 user nova-compute[76161]:       <serial>80815466-0bc1-43dd-8a76-979ef49da369</serial>
Nov 14 18:01:02 user nova-compute[76161]:     </disk>
Nov 14 18:01:02 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:01:02 user nova-compute[76161]:       <mac address="fa:16:3e:be:d3:16"/>
Nov 14 18:01:02 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:01:02 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:01:02 user nova-compute[76161]:       <target dev="tap23a82f81-d0"/>
Nov 14 18:01:02 user nova-compute[76161]:     </interface>
Nov 14 18:01:02 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:01:02 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/console.log" append="off"/>
Nov 14 18:01:02 user nova-compute[76161]:     </serial>
Nov 14 18:01:02 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:01:02 user nova-compute[76161]:     <video>
Nov 14 18:01:02 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:01:02 user nova-compute[76161]:     </video>
Nov 14 18:01:02 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:01:02 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:01:02 user nova-compute[76161]:     </rng>
Nov 14 18:01:02 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:01:02 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:01:02 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:01:02 user nova-compute[76161]:     </memballoon>
Nov 14 18:01:02 user nova-compute[76161]:   </devices>
Nov 14 18:01:02 user nova-compute[76161]: </domain>
Nov 14 18:01:02 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-431593191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-431593191',id=36,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-630lejpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:00:50Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=cd162511-a09b-4479-8d29-0a5a4b40ae78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:16,bridge_name='br-int',has_traffic_filtering=True,id=23a82f81-d0bf-420c-a9f9-e8241d7524c5,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a82f81-d0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_vif [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:16,bridge_name='br-int',has_traffic_filtering=True,id=23a82f81-d0bf-420c-a9f9-e8241d7524c5,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a82f81-d0') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:01:02 user nova-compute[76161]: INFO nova.compute.manager [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Shelve offloading
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ace1d7f0-175e-5070-a8d9-474bc5db42f4', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a634f1bd-8154-4b5b-8cff-24d749a011be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23a82f81-d0, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23a82f81-d0, col_values=(('qos', UUID('cc56e395-3e09-4ccc-85ff-a6822ecb1a5b')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23a82f81-d0, col_values=(('external_ids', {'iface-id': '23a82f81-d0bf-420c-a9f9-e8241d7524c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:d3:16', 'vm-uuid': 'cd162511-a09b-4479-8d29-0a5a4b40ae78'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Instance destroyed successfully.
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquired lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:02 user nova-compute[76161]: INFO os_vif [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:d3:16,bridge_name='br-int',has_traffic_filtering=True,id=23a82f81-d0bf-420c-a9f9-e8241d7524c5,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a82f81-d0')
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfa3e6d-52b9-42ca-bfed-353fe4e4992e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:02 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:02 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:01:02 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:02 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:02 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:02 user nova-compute[76161]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 (non-flash)
Nov 14 18:01:02 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:02 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f014f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752'): ({'sde'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Removing single pathed devices sde {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ad61cb-06dc-4cd5-92b6-1f342b50e48a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No VIF found with MAC fa:16:3e:be:d3:16, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[37571e89-3cd8-40b5-afcb-31cc53d73e08]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Flushing IO for device /dev/sde {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d0546-eaae-47a3-a016-8f8e4fcbaf1b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d5393e-5f0a-4156-9afc-a571f5e38014]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3404a5c-7bb1-4b5b-8ce1-ffec2334a0e8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a052e63-2fb5-4a61-9ca9-5a9b6125e20e]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752, portal: 172.16.0.220,3260]
Nov 14 18:01:02 user nova-compute[76161]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752, portal: 172.16.0.220,3260] successful.
Nov 14 18:01:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4e1e673-3aed-4b88-9155-67bfe8f54752 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f866e8a-2b1e-480a-80e7-b50e761aaab9]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] <== disconnect_volume: return (1320ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.743s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f631c350-d60b-4cb1-bf0a-25273b69228f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:01:03 user nova-compute[76161]: No targets found.
Nov 14 18:01:03 user nova-compute[76161]: iSNS:
Nov 14 18:01:03 user nova-compute[76161]: No targets found.
Nov 14 18:01:03 user nova-compute[76161]: STATIC:
Nov 14 18:01:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:01:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:01:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:01:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:01:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:03 user nova-compute[76161]: FIRMWARE:
Nov 14 18:01:03 user nova-compute[76161]: No targets found.
Nov 14 18:01:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:01:03 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:01:03 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6338742-2c54-4303-b3b6-429857d2cffc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[518630e1-c54c-4c7f-ada0-0102698ccfd1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0172f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac2b574-f88f-4293-8aa7-0fd308a24236]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1872c098-f2da-4b2a-8575-ca5c57e0c8fe]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a08050-09cb-47cf-acb7-a64be447a536]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updating instance_info_cache with network_info: [{"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Releasing lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8cf924-95d1-43ec-b2aa-ba943162bc1e]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc2e218-24ec-41a5-bdd6-c8d5e8949143]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc80ad71-f6a6-4f45-88ea-948fc6a19250]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260]
Nov 14 18:01:03 user nova-compute[76161]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260] successful.
Nov 14 18:01:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5e360e-f400-4bfd-b72c-d29854a96355]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== disconnect_volume: return (1143ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Start _get_guest_xml network_info=[{"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQzrRHBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '75295499-8f99-4c9b-a556-c1287c61d8f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0aadcea-0bc4-46b4-b4a5-77abc43079a8', 'serial': 'b0aadcea-0bc4-46b4-b4a5-77abc43079a8'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'fd7b93c0-2533-483d-b7db-2e3a51112f21', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'numa_topology' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.objects.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:01:03 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:01:03 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'vcpu_model' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.objects.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQzrRHBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:03 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:03 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:03 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e42250-7c1c-49bf-b463-42c5e5b79ca3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:01:03 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c71ccc-734c-44bf-909d-e0b03c82dd70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8] added
Nov 14 18:01:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1712973-df2f-4067-9822-4a797ae0932c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c4fce-b28a-44ff-94d2-14550a490dce]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQzrRHBt {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQzrRHBt" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd3b7f4-9189-4f86-8c86-e7b8b3551c05]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KQzrRHBt'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b423b3-194f-49ce-a22d-d0a54e5b3b19]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a95fe69-aa4b-4363-b1b4-ccdf71f69a55]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e150e4d3-d4ad-4f74-80e2-5be4bc27c6fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260]
Nov 14 18:01:03 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260] successful.
Nov 14 18:01:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[56405129-8e06-4c2d-867f-5d60544f247c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Instance destroyed successfully.
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'resources' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8277a020-c26b-4300-8e23-9701036acb72]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:03 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-702be84b-d725-4e5b-86a5-80b3b85575e1 req-9f4c900b-4694-493f-a4fe-668f8f7f1801 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-changed-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-702be84b-d725-4e5b-86a5-80b3b85575e1 req-9f4c900b-4694-493f-a4fe-668f8f7f1801 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Refreshing instance network info cache due to event network-changed-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-702be84b-d725-4e5b-86a5-80b3b85575e1 req-9f4c900b-4694-493f-a4fe-668f8f7f1801 service nova] Acquiring lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-702be84b-d725-4e5b-86a5-80b3b85575e1 req-9f4c900b-4694-493f-a4fe-668f8f7f1801 service nova] Acquired lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.network.neutron [req-702be84b-d725-4e5b-86a5-80b3b85575e1 req-9f4c900b-4694-493f-a4fe-668f8f7f1801 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Refreshing network info cache for port 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1148321708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1148321708',id=32,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWDC5huzIpKEHV7/Vtzw1d40g9OR0Xm02D0MURyQiuMKFJcZ6JPA6YiqIW1t7K6sD6LZw3Pp8mE2Ox2eP8kBTzl19n94U5ATtytTpddmzWU30WOCt5Vh7+HiX5AzmSg3g==',key_name='tempest-keypair-926458659',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-fw12nx7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member',shelved_at='2023-11-14T18:01:02.593459',shelved_host='user',shelved_image_id='bcedc9eb-1818-47de-ad98-5dbd9af93102'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=72ea8ec0-29d3-49f1-bd61-7047aabfbaff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_vif [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[250763eb-9eff-4b5c-a223-81b02929f7c9]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQzrRHBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61e4ef5f-6f, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89daa2b0-89ba-412d-b394-afa220cf1a0e) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:03 user nova-compute[76161]: INFO os_vif [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f')
Nov 14 18:01:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Deleting instance files /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff_del
Nov 14 18:01:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Deletion of /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff_del complete
Nov 14 18:01:03 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lazy-loading 'flavor' on Instance uuid 952593b7-cc8b-4d50-8aa8-a50e385e088b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7a207516-2a89-4c04-9871-7ab89e11b52b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.917s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:04 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Deleted allocations for instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff
Nov 14 18:01:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'numa_topology' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.objects.base [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Object Instance<72ea8ec0-29d3-49f1-bd61-7047aabfbaff> lazy-loaded attributes: resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.network.neutron [req-702be84b-d725-4e5b-86a5-80b3b85575e1 req-9f4c900b-4694-493f-a4fe-668f8f7f1801 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updated VIF entry in instance network info cache for port 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.network.neutron [req-702be84b-d725-4e5b-86a5-80b3b85575e1 req-9f4c900b-4694-493f-a4fe-668f8f7f1801 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updating instance_info_cache with network_info: [{"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-24eff833-49e2-42e4-83fe-1c26419aa972 req-c255af67-762d-471b-8607-b279c5cbf6c8 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-24eff833-49e2-42e4-83fe-1c26419aa972 req-c255af67-762d-471b-8607-b279c5cbf6c8 service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-24eff833-49e2-42e4-83fe-1c26419aa972 req-c255af67-762d-471b-8607-b279c5cbf6c8 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-24eff833-49e2-42e4-83fe-1c26419aa972 req-c255af67-762d-471b-8607-b279c5cbf6c8 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-24eff833-49e2-42e4-83fe-1c26419aa972 req-c255af67-762d-471b-8607-b279c5cbf6c8 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:04 user nova-compute[76161]: WARNING nova.compute.manager [req-24eff833-49e2-42e4-83fe-1c26419aa972 req-c255af67-762d-471b-8607-b279c5cbf6c8 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state building and task_state spawning.
Nov 14 18:01:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-702be84b-d725-4e5b-86a5-80b3b85575e1 req-9f4c900b-4694-493f-a4fe-668f8f7f1801 service nova] Releasing lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.606s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8717bd46-2f60-47ca-a565-d6b23d3efca8 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.457s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23662313330636334', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662313330636334', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1792224443',display_name='tempest-AttachVolumeTestJSON-server-1792224443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1792224443',id=24,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwTHCRRw1KxJLD9CcCs2gIwosvX+o4FaLgfSFYOuEANvq2aIipEcsGq1NHxa+NHKqWzzuxELOvKadsYZSKZeiQ7BOeCDXZ3VUvf4hvZmX1n4PdafIxgOfEgrSs9aoeq3Q==',key_name='tempest-keypair-1778122280',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-iw0i0sws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=75295499-8f99-4c9b-a556-c1287c61d8f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'pci_devices' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.objects.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:01:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:01:04 user nova-compute[76161]:   <uuid>75295499-8f99-4c9b-a556-c1287c61d8f2</uuid>
Nov 14 18:01:04 user nova-compute[76161]:   <name>instance-00000018</name>
Nov 14 18:01:04 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:01:04 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:01:04 user nova-compute[76161]:   <metadata>
Nov 14 18:01:04 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:01:04 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:01:04 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeTestJSON-server-1792224443</nova:name>
Nov 14 18:01:04 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:01:03</nova:creationTime>
Nov 14 18:01:04 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:01:04 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:01:04 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:01:04 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:01:04 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:01:04 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:01:04 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:01:04 user nova-compute[76161]:       <nova:owner>
Nov 14 18:01:04 user nova-compute[76161]:         <nova:user uuid="89b7172f3aea4ef29587ca01c39be2f6">tempest-AttachVolumeTestJSON-1978358229-project-member</nova:user>
Nov 14 18:01:04 user nova-compute[76161]:         <nova:project uuid="0413439dcb2e49d496bf267c63163178">tempest-AttachVolumeTestJSON-1978358229</nova:project>
Nov 14 18:01:04 user nova-compute[76161]:       </nova:owner>
Nov 14 18:01:04 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:01:04 user nova-compute[76161]:       <nova:ports>
Nov 14 18:01:04 user nova-compute[76161]:         <nova:port uuid="d9c3c5f8-f77b-4475-9693-c63f6e310d19">
Nov 14 18:01:04 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 18:01:04 user nova-compute[76161]:         </nova:port>
Nov 14 18:01:04 user nova-compute[76161]:       </nova:ports>
Nov 14 18:01:04 user nova-compute[76161]:     </nova:instance>
Nov 14 18:01:04 user nova-compute[76161]:   </metadata>
Nov 14 18:01:04 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:01:04 user nova-compute[76161]:     <system>
Nov 14 18:01:04 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:01:04 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:01:04 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:01:04 user nova-compute[76161]:       <entry name="serial">75295499-8f99-4c9b-a556-c1287c61d8f2</entry>
Nov 14 18:01:04 user nova-compute[76161]:       <entry name="uuid">75295499-8f99-4c9b-a556-c1287c61d8f2</entry>
Nov 14 18:01:04 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:01:04 user nova-compute[76161]:     </system>
Nov 14 18:01:04 user nova-compute[76161]:   </sysinfo>
Nov 14 18:01:04 user nova-compute[76161]:   <os>
Nov 14 18:01:04 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:01:04 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:01:04 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:01:04 user nova-compute[76161]:   </os>
Nov 14 18:01:04 user nova-compute[76161]:   <features>
Nov 14 18:01:04 user nova-compute[76161]:     <acpi/>
Nov 14 18:01:04 user nova-compute[76161]:     <apic/>
Nov 14 18:01:04 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:01:04 user nova-compute[76161]:   </features>
Nov 14 18:01:04 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:01:04 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:01:04 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:01:04 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:01:04 user nova-compute[76161]:   </clock>
Nov 14 18:01:04 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:01:04 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:01:04 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:01:04 user nova-compute[76161]:   </cpu>
Nov 14 18:01:04 user nova-compute[76161]:   <devices>
Nov 14 18:01:04 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:01:04 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:01:04 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk"/>
Nov 14 18:01:04 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:01:04 user nova-compute[76161]:     </disk>
Nov 14 18:01:04 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:01:04 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:04 user nova-compute[76161]:       <source dev="/dev/sdb"/>
Nov 14 18:01:04 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 18:01:04 user nova-compute[76161]:       <serial>b0aadcea-0bc4-46b4-b4a5-77abc43079a8</serial>
Nov 14 18:01:04 user nova-compute[76161]:     </disk>
Nov 14 18:01:04 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:01:04 user nova-compute[76161]:       <mac address="fa:16:3e:38:ed:cd"/>
Nov 14 18:01:04 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:01:04 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:01:04 user nova-compute[76161]:       <target dev="tapd9c3c5f8-f7"/>
Nov 14 18:01:04 user nova-compute[76161]:     </interface>
Nov 14 18:01:04 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:01:04 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/console.log" append="off"/>
Nov 14 18:01:04 user nova-compute[76161]:     </serial>
Nov 14 18:01:04 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:01:04 user nova-compute[76161]:     <video>
Nov 14 18:01:04 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:01:04 user nova-compute[76161]:     </video>
Nov 14 18:01:04 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:01:04 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:01:04 user nova-compute[76161]:     </rng>
Nov 14 18:01:04 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:01:04 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:01:04 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:01:04 user nova-compute[76161]:     </memballoon>
Nov 14 18:01:04 user nova-compute[76161]:   </devices>
Nov 14 18:01:04 user nova-compute[76161]: </domain>
Nov 14 18:01:04 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'trusted_certs' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG nova.objects.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Cannot resize image /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'migration_context' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG nova.objects.base [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1792224443',display_name='tempest-AttachVolumeTestJSON-server-1792224443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1792224443',id=24,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwTHCRRw1KxJLD9CcCs2gIwosvX+o4FaLgfSFYOuEANvq2aIipEcsGq1NHxa+NHKqWzzuxELOvKadsYZSKZeiQ7BOeCDXZ3VUvf4hvZmX1n4PdafIxgOfEgrSs9aoeq3Q==',key_name='tempest-keypair-1778122280',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-iw0i0sws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=75295499-8f99-4c9b-a556-c1287c61d8f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG os_vif [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f60c8db-9b1f-594b-bb34-d3400478db28', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9c3c5f8-f7, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9c3c5f8-f7, col_values=(('qos', UUID('0c6434b6-0480-4bc4-8b26-6d2c7e332a22')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9c3c5f8-f7, col_values=(('external_ids', {'iface-id': 'd9c3c5f8-f77b-4475-9693-c63f6e310d19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ed:cd', 'vm-uuid': '75295499-8f99-4c9b-a556-c1287c61d8f2'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:05 user nova-compute[76161]: INFO os_vif [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7')
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-a3b0bff7-94b2-465e-9abe-1b6bafd292ee req-c4da597f-0cd1-4c54-8e16-9a2cfbe7f87f service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a3b0bff7-94b2-465e-9abe-1b6bafd292ee req-c4da597f-0cd1-4c54-8e16-9a2cfbe7f87f service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a3b0bff7-94b2-465e-9abe-1b6bafd292ee req-c4da597f-0cd1-4c54-8e16-9a2cfbe7f87f service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a3b0bff7-94b2-465e-9abe-1b6bafd292ee req-c4da597f-0cd1-4c54-8e16-9a2cfbe7f87f service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-a3b0bff7-94b2-465e-9abe-1b6bafd292ee req-c4da597f-0cd1-4c54-8e16-9a2cfbe7f87f service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:06 user nova-compute[76161]: WARNING nova.compute.manager [req-a3b0bff7-94b2-465e-9abe-1b6bafd292ee req-c4da597f-0cd1-4c54-8e16-9a2cfbe7f87f service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state building and task_state spawning.
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:01:06 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Instance spawned successfully.
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:01:06 user nova-compute[76161]: INFO nova.compute.manager [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 14 18:01:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:01:06 user nova-compute[76161]: INFO nova.compute.manager [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Took 18.22 seconds to build instance.
Nov 14 18:01:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3e7b8895-4689-4cf6-9cac-cc09d84e6863 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.316s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-9b0f221d-785b-4b8f-ae7f-8c7021e3fd46 req-74fcb7a0-bef9-43c2-86b1-e4868fb162e6 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9b0f221d-785b-4b8f-ae7f-8c7021e3fd46 req-74fcb7a0-bef9-43c2-86b1-e4868fb162e6 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9b0f221d-785b-4b8f-ae7f-8c7021e3fd46 req-74fcb7a0-bef9-43c2-86b1-e4868fb162e6 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9b0f221d-785b-4b8f-ae7f-8c7021e3fd46 req-74fcb7a0-bef9-43c2-86b1-e4868fb162e6 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-9b0f221d-785b-4b8f-ae7f-8c7021e3fd46 req-74fcb7a0-bef9-43c2-86b1-e4868fb162e6 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:07 user nova-compute[76161]: WARNING nova.compute.manager [req-9b0f221d-785b-4b8f-ae7f-8c7021e3fd46 req-74fcb7a0-bef9-43c2-86b1-e4868fb162e6 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state stopped and task_state powering-on.
Nov 14 18:01:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:09 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:01:09 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance rebooted successfully.
Nov 14 18:01:09 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5d376824-82a2-4dab-b477-37a03f339fe6 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:01:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-316f9f2d-3eec-4859-bd4e-3fc0a67e4e45 req-de855dd3-83cc-4dab-8ecb-363a1d437e4f service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-316f9f2d-3eec-4859-bd4e-3fc0a67e4e45 req-de855dd3-83cc-4dab-8ecb-363a1d437e4f service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-316f9f2d-3eec-4859-bd4e-3fc0a67e4e45 req-de855dd3-83cc-4dab-8ecb-363a1d437e4f service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-316f9f2d-3eec-4859-bd4e-3fc0a67e4e45 req-de855dd3-83cc-4dab-8ecb-363a1d437e4f service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-316f9f2d-3eec-4859-bd4e-3fc0a67e4e45 req-de855dd3-83cc-4dab-8ecb-363a1d437e4f service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:09 user nova-compute[76161]: WARNING nova.compute.manager [req-316f9f2d-3eec-4859-bd4e-3fc0a67e4e45 req-de855dd3-83cc-4dab-8ecb-363a1d437e4f service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state stopped and task_state powering-on.
Nov 14 18:01:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:01:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:01:21 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:01:21 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:01:21 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b/disk --force-share --output=json" returned: 0 in 0.414s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-5e16b3f3-f61f-4727-8b6f-c9d7ab947509 req-a65a0d7a-48a2-4b47-b2b8-6170d47cc797 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received event network-changed-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-5e16b3f3-f61f-4727-8b6f-c9d7ab947509 req-a65a0d7a-48a2-4b47-b2b8-6170d47cc797 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Refreshing instance network info cache due to event network-changed-ac8b1015-35a1-4861-ada7-d67db570f0c2. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5e16b3f3-f61f-4727-8b6f-c9d7ab947509 req-a65a0d7a-48a2-4b47-b2b8-6170d47cc797 service nova] Acquiring lock "refresh_cache-f8df16e2-c87f-432e-a639-f4d4931d9902" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5e16b3f3-f61f-4727-8b6f-c9d7ab947509 req-a65a0d7a-48a2-4b47-b2b8-6170d47cc797 service nova] Acquired lock "refresh_cache-f8df16e2-c87f-432e-a639-f4d4931d9902" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-5e16b3f3-f61f-4727-8b6f-c9d7ab947509 req-a65a0d7a-48a2-4b47-b2b8-6170d47cc797 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Refreshing network info cache for port ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.objects.instance [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:01:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=6859MB free_disk=24.920398712158203GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:28 user nova-compute[76161]: INFO nova.compute.manager [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attaching volume 6f68c4d0-e901-4923-9396-26f374fe645d to /dev/vdb
Nov 14 18:01:28 user nova-compute[76161]: DEBUG os_brick.utils [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf9391f-07bd-4374-afd0-974dd58528d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf09818-c700-49c8-a99c-9b32af4dd11b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.network.neutron [req-5e16b3f3-f61f-4727-8b6f-c9d7ab947509 req-a65a0d7a-48a2-4b47-b2b8-6170d47cc797 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Updated VIF entry in instance network info cache for port ac8b1015-35a1-4861-ada7-d67db570f0c2. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.network.neutron [req-5e16b3f3-f61f-4727-8b6f-c9d7ab947509 req-a65a0d7a-48a2-4b47-b2b8-6170d47cc797 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Updating instance_info_cache with network_info: [{"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3fab39-1ddc-4c7a-bb2d-6b40072e11e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ac15f0-b4c8-4c77-b137-f93d4d78d502]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 75295499-8f99-4c9b-a556-c1287c61d8f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 952593b7-cc8b-4d50-8aa8-a50e385e088b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 385ef873-fc1f-46ae-90da-b75f82524b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance f8df16e2-c87f-432e-a639-f4d4931d9902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1653be4a-11b6-43cb-996a-d759761c8411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0a5d3ce-4564-434d-9650-36548fb33ab0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance cd162511-a09b-4479-8d29-0a5a4b40ae78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5e16b3f3-f61f-4727-8b6f-c9d7ab947509 req-a65a0d7a-48a2-4b47-b2b8-6170d47cc797 service nova] Releasing lock "refresh_cache-f8df16e2-c87f-432e-a639-f4d4931d9902" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:01:28 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:01:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39708d0-b908-447a-b7ac-ec1cbaadf107]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG os_brick.utils [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:28 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Updating existing volume attachment record: beaa2a82-37a4-4576-acfc-b37260ff8e3e {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:01:29 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:01:29 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:01:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:01:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.755s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:29 user nova-compute[76161]: INFO nova.compute.manager [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Unshelving
Nov 14 18:01:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "f8df16e2-c87f-432e-a639-f4d4931d9902" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:29 user nova-compute[76161]: INFO nova.virt.block_device [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Booting with volume 0e4f3142-43f5-498f-aeb1-fb864728fb4a at /dev/vda
Nov 14 18:01:29 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lazy-loading 'flavor' on Instance uuid f8df16e2-c87f-432e-a639-f4d4931d9902 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.utils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a0e8c9-e3af-4823-bb52-6587963b3292]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca65cf03-0dbf-4423-bfaf-9876e2fdead3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b13fdc-8646-424c-b2dc-4aec98d811bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[84264092-fc5c-483d-886f-1a7b33e71a8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:01:30 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf562f8-1bb3-47f6-b030-28a576375612]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.utils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating existing volume attachment record: 1b10c1f7-2d84-4dac-a9fa-6b57a471b09e {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "f8df16e2-c87f-432e-a639-f4d4931d9902" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:30 user nova-compute[76161]: INFO nova.compute.manager [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Attaching volume cd991a19-3205-4c90-8edd-4c86cfc195ae to /dev/vdb
Nov 14 18:01:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.utils [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eae2d1-5a74-464a-93a2-9f6a671be6fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b8ff22-2d7c-4d14-90a5-491e76f83237]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c733ba-5b00-4eb8-8ccf-9bdaa6daa2da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12c2293-7365-474d-923f-bac8d3897ce4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:01:30 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:01:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e723102-0a39-4633-b9b8-2b5346c058a7]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG os_brick.utils [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Updating existing volume attachment record: 8a204e9c-3964-4e15-8a6d-e6c88893edf6 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:01:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQWbgfuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:34 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:34 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:34 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a2b993-e200-4ba5-bc45-9f4360be5d30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:01:34 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e509087-e21a-4c2e-bf8f-f426d7c62f1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae] added
Nov 14 18:01:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec0fb6d-018e-4eaf-824c-a385e4423c46]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b5487-897b-4268-8ab8-352382e8bd13]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UQWbgfuc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UQWbgfuc" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db891a5-891f-429f-9ae3-664981703281]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UQWbgfuc'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[59946fee-3cf7-4061-b24c-a4670e1ba122]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b9a3e1-428b-4ae0-a510-76434f5e5f5a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:34 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:34 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:34 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:34 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:34 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:34 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba123c9-5037-4e83-b961-6f21cd3b2f64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae, portal: 172.16.0.220,3260]
Nov 14 18:01:35 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae, portal: 172.16.0.220,3260] successful.
Nov 14 18:01:35 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a4e601-25bd-4579-b9d6-c68050e4160b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d7ffe3-986c-4e62-95f1-5bf64096ed43]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:35 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:35 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:35 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:35 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:35 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:35 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:35 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:35 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:35 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:35 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d897181c-813f-4db7-b250-53510eb2de24]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQWbgfuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:35 user nova-compute[76161]: INFO nova.compute.manager [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Terminating instance
Nov 14 18:01:35 user nova-compute[76161]: DEBUG nova.compute.manager [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-27aac8ec-2e9b-45ff-bd4c-d58d5f7c7150 req-1acfacf1-0b66-4edd-ae36-5a94d4df0a56 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received event network-vif-unplugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-27aac8ec-2e9b-45ff-bd4c-d58d5f7c7150 req-1acfacf1-0b66-4edd-ae36-5a94d4df0a56 service nova] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-27aac8ec-2e9b-45ff-bd4c-d58d5f7c7150 req-1acfacf1-0b66-4edd-ae36-5a94d4df0a56 service nova] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-27aac8ec-2e9b-45ff-bd4c-d58d5f7c7150 req-1acfacf1-0b66-4edd-ae36-5a94d4df0a56 service nova] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-27aac8ec-2e9b-45ff-bd4c-d58d5f7c7150 req-1acfacf1-0b66-4edd-ae36-5a94d4df0a56 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] No waiting events found dispatching network-vif-unplugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-27aac8ec-2e9b-45ff-bd4c-d58d5f7c7150 req-1acfacf1-0b66-4edd-ae36-5a94d4df0a56 service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received event network-vif-unplugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:01:35 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Instance destroyed successfully.
Nov 14 18:01:35 user nova-compute[76161]: DEBUG nova.objects.instance [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lazy-loading 'resources' on Instance uuid 952593b7-cc8b-4d50-8aa8-a50e385e088b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1882407709',display_name='tempest-TestServerVolumeAttachmentScenario-server-1882407709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1882407709',id=26,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+4/DN5Ily1A4h0678494WRM3uSqapZDyhe6rp4gOPRCchQjvBHHNRxmViH0sFPYNwi3iVTbF0beE9Z73Dl3YtwY1kRwOKPlAAOM8gZbRhoI3ZndnUytL0SBlFF/gdIQg==',key_name='tempest-keypair-584016234',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1742bececec94ff8bbd69773788c05e9',ramdisk_id='',reservation_id='r-a8ok6d9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1591584694',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1591584694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57d10aae86db4e6cac70ba82a4de78c5',uuid=952593b7-cc8b-4d50-8aa8-a50e385e088b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Converting VIF {"id": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "address": "fa:16:3e:29:91:d7", "network": {"id": "0b0526d0-1417-4be5-84ed-3e77cf62c36f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-51275399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1742bececec94ff8bbd69773788c05e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacaa3207-c1", "ovs_interfaceid": "acaa3207-c1d5-4d0a-ad74-de7cb45ab810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:91:d7,bridge_name='br-int',has_traffic_filtering=True,id=acaa3207-c1d5-4d0a-ad74-de7cb45ab810,network=Network(0b0526d0-1417-4be5-84ed-3e77cf62c36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaa3207-c1') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG os_vif [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:91:d7,bridge_name='br-int',has_traffic_filtering=True,id=acaa3207-c1d5-4d0a-ad74-de7cb45ab810,network=Network(0b0526d0-1417-4be5-84ed-3e77cf62c36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaa3207-c1') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacaa3207-c1, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f13d2c1a-343b-4be4-b593-b5363a60f0d6) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:35 user nova-compute[76161]: INFO os_vif [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:91:d7,bridge_name='br-int',has_traffic_filtering=True,id=acaa3207-c1d5-4d0a-ad74-de7cb45ab810,network=Network(0b0526d0-1417-4be5-84ed-3e77cf62c36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacaa3207-c1')
Nov 14 18:01:35 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Deleting instance files /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b_del
Nov 14 18:01:35 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Deletion of /opt/stack/data/nova/instances/952593b7-cc8b-4d50-8aa8-a50e385e088b_del complete
Nov 14 18:01:35 user nova-compute[76161]: INFO nova.compute.manager [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 18:01:35 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:01:35 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26638363335326432', 'path': '/dev/sde'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638363335326432', 'path': '/dev/sde'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lazy-loading 'flavor' on Instance uuid f8df16e2-c87f-432e-a639-f4d4931d9902 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:01:36 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:36 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:01:36 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:01:36 user nova-compute[76161]:   <serial>cd991a19-3205-4c90-8edd-4c86cfc195ae</serial>
Nov 14 18:01:36 user nova-compute[76161]: </disk>
Nov 14 18:01:36 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] No VIF found with MAC fa:16:3e:d7:b7:11, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:01:36 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Took 0.74 seconds to deallocate network for instance.
Nov 14 18:01:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2a0c0445-ca70-4c50-a412-4130c3f0c776 tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.563s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:37 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Deleted allocations for instance 952593b7-cc8b-4d50-8aa8-a50e385e088b
Nov 14 18:01:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-19068289-7f0f-47d8-8c4b-5aa08de9de0b tempest-TestServerVolumeAttachmentScenario-1591584694 tempest-TestServerVolumeAttachmentScenario-1591584694-project-member] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.329s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-6ec07ba1-f2bf-40a6-9153-b21253df85df req-ab6829bf-24c4-4b69-9735-bf1c69604a7f service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received event network-vif-plugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6ec07ba1-f2bf-40a6-9153-b21253df85df req-ab6829bf-24c4-4b69-9735-bf1c69604a7f service nova] Acquiring lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6ec07ba1-f2bf-40a6-9153-b21253df85df req-ab6829bf-24c4-4b69-9735-bf1c69604a7f service nova] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6ec07ba1-f2bf-40a6-9153-b21253df85df req-ab6829bf-24c4-4b69-9735-bf1c69604a7f service nova] Lock "952593b7-cc8b-4d50-8aa8-a50e385e088b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-6ec07ba1-f2bf-40a6-9153-b21253df85df req-ab6829bf-24c4-4b69-9735-bf1c69604a7f service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] No waiting events found dispatching network-vif-plugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:37 user nova-compute[76161]: WARNING nova.compute.manager [req-6ec07ba1-f2bf-40a6-9153-b21253df85df req-ab6829bf-24c4-4b69-9735-bf1c69604a7f service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received unexpected event network-vif-plugged-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 for instance with vm_state deleted and task_state None.
Nov 14 18:01:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-6ec07ba1-f2bf-40a6-9153-b21253df85df req-ab6829bf-24c4-4b69-9735-bf1c69604a7f service nova] [instance: 952593b7-cc8b-4d50-8aa8-a50e385e088b] Received event network-vif-deleted-acaa3207-c1d5-4d0a-ad74-de7cb45ab810 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "f8df16e2-c87f-432e-a639-f4d4931d9902" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:37 user nova-compute[76161]: INFO nova.compute.manager [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Detaching volume cd991a19-3205-4c90-8edd-4c86cfc195ae
Nov 14 18:01:37 user nova-compute[76161]: INFO nova.virt.block_device [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Attempting to driver detach volume cd991a19-3205-4c90-8edd-4c86cfc195ae from mountpoint /dev/vdb
Nov 14 18:01:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Attempting to detach device vdb from instance f8df16e2-c87f-432e-a639-f4d4931d9902 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:01:37 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:37 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:01:37 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:01:37 user nova-compute[76161]:   <serial>cd991a19-3205-4c90-8edd-4c86cfc195ae</serial>
Nov 14 18:01:37 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:01:37 user nova-compute[76161]: </disk>
Nov 14 18:01:37 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:01:37 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Successfully detached device vdb from instance f8df16e2-c87f-432e-a639-f4d4931d9902 from the persistent domain config.
Nov 14 18:01:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8df16e2-c87f-432e-a639-f4d4931d9902 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:01:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:01:37 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:37 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:01:37 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:01:37 user nova-compute[76161]:   <serial>cd991a19-3205-4c90-8edd-4c86cfc195ae</serial>
Nov 14 18:01:37 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:01:37 user nova-compute[76161]: </disk>
Nov 14 18:01:37 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuykQxCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:38 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:38 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:38 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d5e628-d146-43a2-9827-7235372c6410]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:01:38 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f05a35-5799-4301-8535-39bd7e7505a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d] added
Nov 14 18:01:38 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8df16e2-c87f-432e-a639-f4d4931d9902 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19dd5ea-374f-4550-adbc-dabc418e5b02]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[456af172-c921-429a-a463-79c885bf2286]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuykQxCp {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuykQxCp" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3264a537-3c69-42a8-8de5-9ded23b197c8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuykQxCp'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9d47d1-ddd5-4191-bc33-2976f50c93eb]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lazy-loading 'pci_requests' on Instance uuid c6f53da9-e029-4aa7-8dad-edd41eb2eb5d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[af417880-e0e4-4ad0-81f3-6aa8de9849e0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:38 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:38 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lazy-loading 'numa_topology' on Instance uuid c6f53da9-e029-4aa7-8dad-edd41eb2eb5d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:01:38 user nova-compute[76161]: INFO nova.compute.claims [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Claim successful on node user
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc605b3-7749-4149-8599-cee87c394f4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d, portal: 172.16.0.220,3260]
Nov 14 18:01:38 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d, portal: 172.16.0.220,3260] successful.
Nov 14 18:01:38 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6214c6b-ed85-4c8c-afac-45c8f7517fcb]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c14e59-21a2-4368-b469-10531bdcf331]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:38 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:38 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:38 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23dfa5c-75ad-47a5-80f5-69bf4bbc5e14]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:01:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuykQxCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:39 user nova-compute[76161]: INFO nova.network.neutron [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating port 17a4e939-dd34-4c8e-b254-079202ca1814 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23064646530343935', 'path': '/dev/sdg'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064646530343935', 'path': '/dev/sdg'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG nova.objects.instance [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:01:39 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:39 user nova-compute[76161]:   <source dev="/dev/sdg"/>
Nov 14 18:01:39 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:01:39 user nova-compute[76161]:   <serial>6f68c4d0-e901-4923-9396-26f374fe645d</serial>
Nov 14 18:01:39 user nova-compute[76161]: </disk>
Nov 14 18:01:39 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquired lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG nova.network.neutron [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-bd838cba-7eae-431e-a089-18b9891c5e33 req-bc204077-1d62-4098-a7a0-28fdcfb7aa43 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-changed-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-bd838cba-7eae-431e-a089-18b9891c5e33 req-bc204077-1d62-4098-a7a0-28fdcfb7aa43 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Refreshing instance network info cache due to event network-changed-17a4e939-dd34-4c8e-b254-079202ca1814. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:01:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd838cba-7eae-431e-a089-18b9891c5e33 req-bc204077-1d62-4098-a7a0-28fdcfb7aa43 service nova] Acquiring lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No VIF found with MAC fa:16:3e:24:51:b7, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating instance_info_cache with network_info: [{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Releasing lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:01:40 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Creating image(s)
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Ensure instance console log exists: /opt/stack/data/nova/instances/c6f53da9-e029-4aa7-8dad-edd41eb2eb5d/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Start _get_guest_xml network_info=[{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrmvRgVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c6f53da9-e029-4aa7-8dad-edd41eb2eb5d', 'attached_at': '', 'detached_at': '', 'volume_id': '0e4f3142-43f5-498f-aeb1-fb864728fb4a', 'serial': '0e4f3142-43f5-498f-aeb1-fb864728fb4a'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '1b10c1f7-2d84-4dac-a9fa-6b57a471b09e', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd838cba-7eae-431e-a089-18b9891c5e33 req-bc204077-1d62-4098-a7a0-28fdcfb7aa43 service nova] Acquired lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-bd838cba-7eae-431e-a089-18b9891c5e33 req-bc204077-1d62-4098-a7a0-28fdcfb7aa43 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Refreshing network info cache for port 17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:01:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:01:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6f53da9-e029-4aa7-8dad-edd41eb2eb5d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eeb2c43e-b9f2-463c-aa37-891996a9f0f5 tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.629s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.objects.base [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Object Instance<c6f53da9-e029-4aa7-8dad-edd41eb2eb5d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrmvRgVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:40 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:40 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:40 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3504ee8a-807c-4975-9043-8eb8f6e07154]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:01:40 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[701c2511-5806-4428-835d-aff2e713f0a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a] added
Nov 14 18:01:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[91351a23-7495-4a72-b257-211fb5119314]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c2e788-0de9-4ae8-b6c9-9522cb22f1d9]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrmvRgVA {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrmvRgVA" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff606fd-e831-479b-8773-37c414dc0644]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrmvRgVA'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3d385f-cad7-4da7-b5ce-bc12c30f8d84]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d0def1-106b-47ba-9acd-4a18ba3d800f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bdfa3c-5cd8-4743-8058-d33cba8f4795]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260]
Nov 14 18:01:40 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260] successful.
Nov 14 18:01:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.061s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b96966a-47ea-4ef4-8e44-e75d0d898288]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-bd838cba-7eae-431e-a089-18b9891c5e33 req-bc204077-1d62-4098-a7a0-28fdcfb7aa43 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updated VIF entry in instance network info cache for port 17a4e939-dd34-4c8e-b254-079202ca1814. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-bd838cba-7eae-431e-a089-18b9891c5e33 req-bc204077-1d62-4098-a7a0-28fdcfb7aa43 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating instance_info_cache with network_info: [{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bd838cba-7eae-431e-a089-18b9891c5e33 req-bc204077-1d62-4098-a7a0-28fdcfb7aa43 service nova] Releasing lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f783539e-ca96-46d8-bbb4-5d6f6ead6441]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:01:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:40 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:01:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] HCTL ('39', '-', '-', 0) found on session 41 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95fb642-c89b-4168-8077-02c35d25eea0]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Searching for a device in session 41 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrmvRgVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:01:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23462663365396237', 'path': '/dev/sdh'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462663365396237', 'path': '/dev/sdh'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-971044589',display_name='tempest-TestShelveInstance-server-971044589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-971044589',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2116969338',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='39dc84f83d834a618106830659fee331',ramdisk_id='',reservation_id='r-05v9kppj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1328804028',owner_user_name='tempest-TestShelveInstance-1328804028-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:01:30Z,user_data=None,user_id='5b6eb8d881b84217b0e138def245cab0',uuid=c6f53da9-e029-4aa7-8dad-edd41eb2eb5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converting VIF {"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lazy-loading 'pci_devices' on Instance uuid c6f53da9-e029-4aa7-8dad-edd41eb2eb5d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.objects.base [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Object Instance<c6f53da9-e029-4aa7-8dad-edd41eb2eb5d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:01:41 user nova-compute[76161]:   <uuid>c6f53da9-e029-4aa7-8dad-edd41eb2eb5d</uuid>
Nov 14 18:01:41 user nova-compute[76161]:   <name>instance-0000001b</name>
Nov 14 18:01:41 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:01:41 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:01:41 user nova-compute[76161]:   <metadata>
Nov 14 18:01:41 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:01:41 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:01:41 user nova-compute[76161]:       <nova:name>tempest-TestShelveInstance-server-971044589</nova:name>
Nov 14 18:01:41 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:01:40</nova:creationTime>
Nov 14 18:01:41 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:01:41 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:01:41 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:01:41 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:01:41 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:01:41 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:01:41 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:01:41 user nova-compute[76161]:       <nova:owner>
Nov 14 18:01:41 user nova-compute[76161]:         <nova:user uuid="5b6eb8d881b84217b0e138def245cab0">tempest-TestShelveInstance-1328804028-project-member</nova:user>
Nov 14 18:01:41 user nova-compute[76161]:         <nova:project uuid="39dc84f83d834a618106830659fee331">tempest-TestShelveInstance-1328804028</nova:project>
Nov 14 18:01:41 user nova-compute[76161]:       </nova:owner>
Nov 14 18:01:41 user nova-compute[76161]:       <nova:ports>
Nov 14 18:01:41 user nova-compute[76161]:         <nova:port uuid="17a4e939-dd34-4c8e-b254-079202ca1814">
Nov 14 18:01:41 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 18:01:41 user nova-compute[76161]:         </nova:port>
Nov 14 18:01:41 user nova-compute[76161]:       </nova:ports>
Nov 14 18:01:41 user nova-compute[76161]:     </nova:instance>
Nov 14 18:01:41 user nova-compute[76161]:   </metadata>
Nov 14 18:01:41 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:01:41 user nova-compute[76161]:     <system>
Nov 14 18:01:41 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:01:41 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:01:41 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:01:41 user nova-compute[76161]:       <entry name="serial">c6f53da9-e029-4aa7-8dad-edd41eb2eb5d</entry>
Nov 14 18:01:41 user nova-compute[76161]:       <entry name="uuid">c6f53da9-e029-4aa7-8dad-edd41eb2eb5d</entry>
Nov 14 18:01:41 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:01:41 user nova-compute[76161]:     </system>
Nov 14 18:01:41 user nova-compute[76161]:   </sysinfo>
Nov 14 18:01:41 user nova-compute[76161]:   <os>
Nov 14 18:01:41 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:01:41 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:01:41 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:01:41 user nova-compute[76161]:   </os>
Nov 14 18:01:41 user nova-compute[76161]:   <features>
Nov 14 18:01:41 user nova-compute[76161]:     <acpi/>
Nov 14 18:01:41 user nova-compute[76161]:     <apic/>
Nov 14 18:01:41 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:01:41 user nova-compute[76161]:   </features>
Nov 14 18:01:41 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:01:41 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:01:41 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:01:41 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:01:41 user nova-compute[76161]:   </clock>
Nov 14 18:01:41 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:01:41 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:01:41 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:01:41 user nova-compute[76161]:   </cpu>
Nov 14 18:01:41 user nova-compute[76161]:   <devices>
Nov 14 18:01:41 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:01:41 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:41 user nova-compute[76161]:       <source dev="/dev/sdh"/>
Nov 14 18:01:41 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:01:41 user nova-compute[76161]:       <serial>0e4f3142-43f5-498f-aeb1-fb864728fb4a</serial>
Nov 14 18:01:41 user nova-compute[76161]:     </disk>
Nov 14 18:01:41 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:01:41 user nova-compute[76161]:       <mac address="fa:16:3e:f0:bd:0b"/>
Nov 14 18:01:41 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:01:41 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:01:41 user nova-compute[76161]:       <target dev="tap17a4e939-dd"/>
Nov 14 18:01:41 user nova-compute[76161]:     </interface>
Nov 14 18:01:41 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:01:41 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/c6f53da9-e029-4aa7-8dad-edd41eb2eb5d/console.log" append="off"/>
Nov 14 18:01:41 user nova-compute[76161]:     </serial>
Nov 14 18:01:41 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:01:41 user nova-compute[76161]:     <video>
Nov 14 18:01:41 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:01:41 user nova-compute[76161]:     </video>
Nov 14 18:01:41 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:01:41 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:01:41 user nova-compute[76161]:     </rng>
Nov 14 18:01:41 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:01:41 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:01:41 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:01:41 user nova-compute[76161]:     </memballoon>
Nov 14 18:01:41 user nova-compute[76161]:   </devices>
Nov 14 18:01:41 user nova-compute[76161]: </domain>
Nov 14 18:01:41 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-971044589',display_name='tempest-TestShelveInstance-server-971044589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-971044589',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2116969338',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='39dc84f83d834a618106830659fee331',ramdisk_id='',reservation_id='r-05v9kppj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1328804028',owner_user_name='tempest-TestShelveInstance-1328804028-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:01:30Z,user_data=None,user_id='5b6eb8d881b84217b0e138def245cab0',uuid=c6f53da9-e029-4aa7-8dad-edd41eb2eb5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converting VIF {"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG os_vif [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9a7653a-7182-5814-b86a-97410dc4ef37', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17a4e939-dd, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17a4e939-dd, col_values=(('qos', UUID('bd4b4c1a-d9ee-42ae-925f-d39732e9fd3c')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17a4e939-dd, col_values=(('external_ids', {'iface-id': '17a4e939-dd34-4c8e-b254-079202ca1814', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:bd:0b', 'vm-uuid': 'c6f53da9-e029-4aa7-8dad-edd41eb2eb5d'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:41 user nova-compute[76161]: INFO os_vif [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd')
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:01:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] No VIF found with MAC fa:16:3e:f0:bd:0b, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:01:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:42 user nova-compute[76161]: INFO nova.compute.manager [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Detaching volume 6f68c4d0-e901-4923-9396-26f374fe645d
Nov 14 18:01:42 user nova-compute[76161]: INFO nova.virt.block_device [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attempting to driver detach volume 6f68c4d0-e901-4923-9396-26f374fe645d from mountpoint /dev/vdb
Nov 14 18:01:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Attempting to detach device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:01:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:01:42 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:42 user nova-compute[76161]:   <source dev="/dev/sdg"/>
Nov 14 18:01:42 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:01:42 user nova-compute[76161]:   <serial>6f68c4d0-e901-4923-9396-26f374fe645d</serial>
Nov 14 18:01:42 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:01:42 user nova-compute[76161]: </disk>
Nov 14 18:01:42 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:01:42 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Successfully detached device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the persistent domain config.
Nov 14 18:01:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:01:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:01:42 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:42 user nova-compute[76161]:   <source dev="/dev/sdg"/>
Nov 14 18:01:42 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:01:42 user nova-compute[76161]:   <serial>6f68c4d0-e901-4923-9396-26f374fe645d</serial>
Nov 14 18:01:42 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:01:42 user nova-compute[76161]: </disk>
Nov 14 18:01:42 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG nova.compute.manager [req-f06e63cf-b273-4079-805f-3c166476e162 req-e6394c7d-a6b0-435d-8b56-13eeeb114c9e service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f06e63cf-b273-4079-805f-3c166476e162 req-e6394c7d-a6b0-435d-8b56-13eeeb114c9e service nova] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f06e63cf-b273-4079-805f-3c166476e162 req-e6394c7d-a6b0-435d-8b56-13eeeb114c9e service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f06e63cf-b273-4079-805f-3c166476e162 req-e6394c7d-a6b0-435d-8b56-13eeeb114c9e service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG nova.compute.manager [req-f06e63cf-b273-4079-805f-3c166476e162 req-e6394c7d-a6b0-435d-8b56-13eeeb114c9e service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] No waiting events found dispatching network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:43 user nova-compute[76161]: WARNING nova.compute.manager [req-f06e63cf-b273-4079-805f-3c166476e162 req-e6394c7d-a6b0-435d-8b56-13eeeb114c9e service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received unexpected event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 18:01:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:01:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:45 user nova-compute[76161]: DEBUG nova.compute.manager [req-8f6ed96e-7906-4e60-bb25-193fd76f7e64 req-c26fb445-57fc-49c3-9781-cee70881aefe service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8f6ed96e-7906-4e60-bb25-193fd76f7e64 req-c26fb445-57fc-49c3-9781-cee70881aefe service nova] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8f6ed96e-7906-4e60-bb25-193fd76f7e64 req-c26fb445-57fc-49c3-9781-cee70881aefe service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8f6ed96e-7906-4e60-bb25-193fd76f7e64 req-c26fb445-57fc-49c3-9781-cee70881aefe service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:45 user nova-compute[76161]: DEBUG nova.compute.manager [req-8f6ed96e-7906-4e60-bb25-193fd76f7e64 req-c26fb445-57fc-49c3-9781-cee70881aefe service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] No waiting events found dispatching network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:45 user nova-compute[76161]: WARNING nova.compute.manager [req-8f6ed96e-7906-4e60-bb25-193fd76f7e64 req-c26fb445-57fc-49c3-9781-cee70881aefe service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received unexpected event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 18:01:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:01:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:01:45 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Instance spawned successfully.
Nov 14 18:01:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:01:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ece7f02-6ae5-4c8e-8a0f-3fb046d6f02f tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.674s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:46 user nova-compute[76161]: DEBUG nova.compute.manager [req-401defd8-fa2e-4a74-85ba-cf1902bce0e7 req-c646e5bc-483c-45bb-acf5-dc891ef5d035 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received event network-changed-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:46 user nova-compute[76161]: DEBUG nova.compute.manager [req-401defd8-fa2e-4a74-85ba-cf1902bce0e7 req-c646e5bc-483c-45bb-acf5-dc891ef5d035 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Refreshing instance network info cache due to event network-changed-d4512664-4563-48f2-bc29-c9a857f8577e. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:01:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-401defd8-fa2e-4a74-85ba-cf1902bce0e7 req-c646e5bc-483c-45bb-acf5-dc891ef5d035 service nova] Acquiring lock "refresh_cache-1653be4a-11b6-43cb-996a-d759761c8411" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:01:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-401defd8-fa2e-4a74-85ba-cf1902bce0e7 req-c646e5bc-483c-45bb-acf5-dc891ef5d035 service nova] Acquired lock "refresh_cache-1653be4a-11b6-43cb-996a-d759761c8411" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:01:46 user nova-compute[76161]: DEBUG nova.network.neutron [req-401defd8-fa2e-4a74-85ba-cf1902bce0e7 req-c646e5bc-483c-45bb-acf5-dc891ef5d035 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Refreshing network info cache for port d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:01:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:46 user nova-compute[76161]: DEBUG nova.network.neutron [req-401defd8-fa2e-4a74-85ba-cf1902bce0e7 req-c646e5bc-483c-45bb-acf5-dc891ef5d035 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Updated VIF entry in instance network info cache for port d4512664-4563-48f2-bc29-c9a857f8577e. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:01:46 user nova-compute[76161]: DEBUG nova.network.neutron [req-401defd8-fa2e-4a74-85ba-cf1902bce0e7 req-c646e5bc-483c-45bb-acf5-dc891ef5d035 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Updating instance_info_cache with network_info: [{"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:01:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-401defd8-fa2e-4a74-85ba-cf1902bce0e7 req-c646e5bc-483c-45bb-acf5-dc891ef5d035 service nova] Releasing lock "refresh_cache-1653be4a-11b6-43cb-996a-d759761c8411" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:01:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "1653be4a-11b6-43cb-996a-d759761c8411" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG nova.objects.instance [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'flavor' on Instance uuid 1653be4a-11b6-43cb-996a-d759761c8411 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "1653be4a-11b6-43cb-996a-d759761c8411" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:48 user nova-compute[76161]: INFO nova.compute.manager [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Attaching volume 6cefafe8-f42a-4486-bc92-93598024808f to /dev/vdb
Nov 14 18:01:48 user nova-compute[76161]: DEBUG os_brick.utils [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7e6544-3a7d-497a-8e99-eaca79bf5c2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caed7b1-bd5f-4be8-a0a7-813cfc73d379]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8259c4c7-6ea0-44a9-be2b-2bcebcf8a3a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5757ca0c-5472-4da8-9431-a0f0bc907028]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:01:48 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:01:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2007824-09f1-4a28-bc89-11d72c262670]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG os_brick.utils [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:48 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Updating existing volume attachment record: a5d95721-5dcb-4445-b1c6-5ca749f086cf {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-ef4e836a-be74-432f-98d7-f90e92aa39b8 req-25fb35db-bc04-436f-83ec-f8a5fadf2278 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received event network-changed-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-ef4e836a-be74-432f-98d7-f90e92aa39b8 req-25fb35db-bc04-436f-83ec-f8a5fadf2278 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Refreshing instance network info cache due to event network-changed-69b8f81e-f7ba-4056-ba8b-5493d55616c8. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ef4e836a-be74-432f-98d7-f90e92aa39b8 req-25fb35db-bc04-436f-83ec-f8a5fadf2278 service nova] Acquiring lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ef4e836a-be74-432f-98d7-f90e92aa39b8 req-25fb35db-bc04-436f-83ec-f8a5fadf2278 service nova] Acquired lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG nova.network.neutron [req-ef4e836a-be74-432f-98d7-f90e92aa39b8 req-25fb35db-bc04-436f-83ec-f8a5fadf2278 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Refreshing network info cache for port 69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:49 user nova-compute[76161]: INFO nova.compute.manager [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Terminating instance
Nov 14 18:01:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-7b599180-1dab-4b14-944f-b95cafbfbf79 req-2b8a40e6-5779-4a52-806f-cdf850e8e9ac service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received event network-vif-unplugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7b599180-1dab-4b14-944f-b95cafbfbf79 req-2b8a40e6-5779-4a52-806f-cdf850e8e9ac service nova] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7b599180-1dab-4b14-944f-b95cafbfbf79 req-2b8a40e6-5779-4a52-806f-cdf850e8e9ac service nova] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7b599180-1dab-4b14-944f-b95cafbfbf79 req-2b8a40e6-5779-4a52-806f-cdf850e8e9ac service nova] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-7b599180-1dab-4b14-944f-b95cafbfbf79 req-2b8a40e6-5779-4a52-806f-cdf850e8e9ac service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] No waiting events found dispatching network-vif-unplugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-7b599180-1dab-4b14-944f-b95cafbfbf79 req-2b8a40e6-5779-4a52-806f-cdf850e8e9ac service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received event network-vif-unplugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.network.neutron [req-ef4e836a-be74-432f-98d7-f90e92aa39b8 req-25fb35db-bc04-436f-83ec-f8a5fadf2278 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updated VIF entry in instance network info cache for port 69b8f81e-f7ba-4056-ba8b-5493d55616c8. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.network.neutron [req-ef4e836a-be74-432f-98d7-f90e92aa39b8 req-25fb35db-bc04-436f-83ec-f8a5fadf2278 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updating instance_info_cache with network_info: [{"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ef4e836a-be74-432f-98d7-f90e92aa39b8 req-25fb35db-bc04-436f-83ec-f8a5fadf2278 service nova] Releasing lock "refresh_cache-6e87b617-e12f-4c33-bd5d-8f1bc07c417b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:01:50 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Instance destroyed successfully.
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lazy-loading 'resources' on Instance uuid 6e87b617-e12f-4c33-bd5d-8f1bc07c417b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1572864524',display_name='tempest-TestStampPattern-server-1572864524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1572864524',id=22,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVn++uY914nMT4ppedFhS8d3dW25Wn2Uz3D0CtpuFA7uYKjt5LP3wVNJBoX8K7AIEJk32VFPhZsLSf9W5T1bKCgwU7sl5Ok2efZd0OuAxtFgTYFlNfvMQAY6AUQQc/vkg==',key_name='tempest-TestStampPattern-1685336557',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b72de616ddd04286a9946e5727b76e85',ramdisk_id='',reservation_id='r-7j140lyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1566874307',owner_user_name='tempest-TestStampPattern-1566874307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:58:00Z,user_data=None,user_id='220334ba1c7744c68e1bd8c2c5c20749',uuid=6e87b617-e12f-4c33-bd5d-8f1bc07c417b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converting VIF {"id": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "address": "fa:16:3e:9b:b5:e3", "network": {"id": "8fd46000-414a-4d3a-8350-24aca85e39b0", "bridge": "br-int", "label": "tempest-TestStampPattern-446562448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b72de616ddd04286a9946e5727b76e85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b8f81e-f7", "ovs_interfaceid": "69b8f81e-f7ba-4056-ba8b-5493d55616c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=69b8f81e-f7ba-4056-ba8b-5493d55616c8,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8f81e-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG os_vif [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=69b8f81e-f7ba-4056-ba8b-5493d55616c8,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8f81e-f7') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69b8f81e-f7, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=444ec1bf-5330-4d62-81c9-6f40a638dc61) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:01:50 user nova-compute[76161]: INFO os_vif [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=69b8f81e-f7ba-4056-ba8b-5493d55616c8,network=Network(8fd46000-414a-4d3a-8350-24aca85e39b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b8f81e-f7')
Nov 14 18:01:50 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Deleting instance files /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b_del
Nov 14 18:01:50 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Deletion of /opt/stack/data/nova/instances/6e87b617-e12f-4c33-bd5d-8f1bc07c417b_del complete
Nov 14 18:01:50 user nova-compute[76161]: INFO nova.compute.manager [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 18:01:50 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:01:50 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:01:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:51 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:01:51 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Took 0.97 seconds to deallocate network for instance.
Nov 14 18:01:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-ecb49ab4-02d9-4076-83a3-5e057047626e req-b5ccbf96-4348-4348-bd02-6be2650dd0bc service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received event network-vif-deleted-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-83238150-d8a8-46e6-bc16-180b5d0b0df8 req-03f71cbc-8063-47d7-bf99-9e0bfa298ab6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received event network-vif-plugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:01:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-83238150-d8a8-46e6-bc16-180b5d0b0df8 req-03f71cbc-8063-47d7-bf99-9e0bfa298ab6 service nova] Acquiring lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-83238150-d8a8-46e6-bc16-180b5d0b0df8 req-03f71cbc-8063-47d7-bf99-9e0bfa298ab6 service nova] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-83238150-d8a8-46e6-bc16-180b5d0b0df8 req-03f71cbc-8063-47d7-bf99-9e0bfa298ab6 service nova] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:52 user nova-compute[76161]: DEBUG nova.compute.manager [req-83238150-d8a8-46e6-bc16-180b5d0b0df8 req-03f71cbc-8063-47d7-bf99-9e0bfa298ab6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] No waiting events found dispatching network-vif-plugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:01:52 user nova-compute[76161]: WARNING nova.compute.manager [req-83238150-d8a8-46e6-bc16-180b5d0b0df8 req-03f71cbc-8063-47d7-bf99-9e0bfa298ab6 service nova] [instance: 6e87b617-e12f-4c33-bd5d-8f1bc07c417b] Received unexpected event network-vif-plugged-69b8f81e-f7ba-4056-ba8b-5493d55616c8 for instance with vm_state deleted and task_state None.
Nov 14 18:01:52 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:01:52 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:01:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:52 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Deleted allocations for instance 6e87b617-e12f-4c33-bd5d-8f1bc07c417b
Nov 14 18:01:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a19c141-44e8-42a0-b3ca-fa73415194e6 tempest-TestStampPattern-1566874307 tempest-TestStampPattern-1566874307-project-member] Lock "6e87b617-e12f-4c33-bd5d-8f1bc07c417b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.656s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyXgChHW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:53 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:53 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:53 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:01:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e0305a-3732-425f-9fbc-070f69d30774]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:01:53 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[613c771c-fa85-472c-b733-c252dc86c00c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f] added
Nov 14 18:01:53 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea7db61-4a1d-45f0-ab4f-32f6aa4fe64d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1919af77-ac1d-40ae-9204-0d129b73c5d0]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyXgChHW {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyXgChHW" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ce63db-6ead-4f0c-bdc2-51f48af984e3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PyXgChHW'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f1445c-58a2-4aa5-bcfa-20adf47e7373]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8922d90-2f47-4617-994b-60288849aaae]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:01:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:01:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7ee182-da72-43eb-ac1a-a71ae895c49d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f, portal: 172.16.0.220,3260]
Nov 14 18:01:54 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f, portal: 172.16.0.220,3260] successful.
Nov 14 18:01:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b82e16e-bf6c-44ad-a03c-799aa21cf45f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa00374-a392-4fa2-9f59-bfd236b887b8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)
Nov 14 18:01:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:01:54 user nova-compute[76161]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)
Nov 14 18:01:54 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] HCTL ('40', '-', '-', 0) found on session 42 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[152b9244-dd16-41a8-b64c-eda9882329ed]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching for a device in session 42 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:01:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyXgChHW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23562646435333936', 'path': '/dev/sdi'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562646435333936', 'path': '/dev/sdi'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG nova.objects.instance [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'flavor' on Instance uuid 1653be4a-11b6-43cb-996a-d759761c8411 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:01:55 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:55 user nova-compute[76161]:   <source dev="/dev/sdi"/>
Nov 14 18:01:55 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:01:55 user nova-compute[76161]:   <serial>6cefafe8-f42a-4486-bc92-93598024808f</serial>
Nov 14 18:01:55 user nova-compute[76161]: </disk>
Nov 14 18:01:55 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No VIF found with MAC fa:16:3e:6b:cc:f6, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:01:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-32fe6d2b-1ea4-427d-aec8-f500a9c5c0d7 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.610s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:01:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "1653be4a-11b6-43cb-996a-d759761c8411" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:01:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:01:57 user nova-compute[76161]: INFO nova.compute.manager [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Detaching volume 6cefafe8-f42a-4486-bc92-93598024808f
Nov 14 18:01:57 user nova-compute[76161]: INFO nova.virt.block_device [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Attempting to driver detach volume 6cefafe8-f42a-4486-bc92-93598024808f from mountpoint /dev/vdb
Nov 14 18:01:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Attempting to detach device vdb from instance 1653be4a-11b6-43cb-996a-d759761c8411 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:01:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:01:57 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:57 user nova-compute[76161]:   <source dev="/dev/sdi"/>
Nov 14 18:01:57 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:01:57 user nova-compute[76161]:   <serial>6cefafe8-f42a-4486-bc92-93598024808f</serial>
Nov 14 18:01:57 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:01:57 user nova-compute[76161]: </disk>
Nov 14 18:01:57 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:01:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully detached device vdb from instance 1653be4a-11b6-43cb-996a-d759761c8411 from the persistent domain config.
Nov 14 18:01:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1653be4a-11b6-43cb-996a-d759761c8411 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:01:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:01:57 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:01:57 user nova-compute[76161]:   <source dev="/dev/sdi"/>
Nov 14 18:01:57 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:01:57 user nova-compute[76161]:   <serial>6cefafe8-f42a-4486-bc92-93598024808f</serial>
Nov 14 18:01:57 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:01:57 user nova-compute[76161]: </disk>
Nov 14 18:01:57 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:01:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1653be4a-11b6-43cb-996a-d759761c8411 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:01:58 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f8df16e2-c87f-432e-a639-f4d4931d9902 is timed out.
Nov 14 18:01:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Successfully detached device vdb from instance f8df16e2-c87f-432e-a639-f4d4931d9902 from the live domain config.
Nov 14 18:01:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQWbgfuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:01:58 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe69fb9-9a24-4acc-b5e9-899df3de4cbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:01:58 user nova-compute[76161]: No targets found.
Nov 14 18:01:58 user nova-compute[76161]: iSNS:
Nov 14 18:01:58 user nova-compute[76161]: No targets found.
Nov 14 18:01:58 user nova-compute[76161]: STATIC:
Nov 14 18:01:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f
Nov 14 18:01:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:01:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae
Nov 14 18:01:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:01:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d
Nov 14 18:01:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:01:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 18:01:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:58 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:01:58 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:01:58 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:01:58 user nova-compute[76161]: FIRMWARE:
Nov 14 18:01:58 user nova-compute[76161]: No targets found.
Nov 14 18:01:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:01:58 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:01:58 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d31e8d-5bf0-4572-b17e-5f67309bb2ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e02ad0-a642-44db-89bc-c37a13d713c3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)
Nov 14 18:01:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:01:58 user nova-compute[76161]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)
Nov 14 18:01:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f81909d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae'): ({'sde'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Removing single pathed devices sde {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c4e6c9-d4a6-47bc-9741-c7277f05721f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[989c4517-becd-452b-8839-9360ffd18dc1]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Flushing IO for device /dev/sde {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1874fbe9-6606-4e51-811a-ffc7a89369ba]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f929355-fdd2-4bce-b917-fb4e33297104]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[710f2573-dc6b-4693-a6ae-b45a68020bec]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8b5826-2232-4395-959e-9766d54a41fd]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae, portal: 172.16.0.220,3260]
Nov 14 18:01:58 user nova-compute[76161]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae, portal: 172.16.0.220,3260] successful.
Nov 14 18:01:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd991a19-3205-4c90-8edd-4c86cfc195ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[908083f0-6271-4f64-a3dc-07f3854f5c1c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] <== disconnect_volume: return (336ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:01:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:01:59 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lazy-loading 'flavor' on Instance uuid f8df16e2-c87f-432e-a639-f4d4931d9902 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:01:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a42f97c7-c801-4f0d-9d57-d264f62aa79e tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.691s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:03 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 is timed out.
Nov 14 18:02:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Successfully detached device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the live domain config.
Nov 14 18:02:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuykQxCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:02:03 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc19db54-2100-49dd-9060-9fb81924319d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:02:03 user nova-compute[76161]: No targets found.
Nov 14 18:02:03 user nova-compute[76161]: iSNS:
Nov 14 18:02:03 user nova-compute[76161]: No targets found.
Nov 14 18:02:03 user nova-compute[76161]: STATIC:
Nov 14 18:02:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f
Nov 14 18:02:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:02:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:02:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d
Nov 14 18:02:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:02:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 18:02:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:03 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:02:03 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:03 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:03 user nova-compute[76161]: FIRMWARE:
Nov 14 18:02:03 user nova-compute[76161]: No targets found.
Nov 14 18:02:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:02:03 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:02:03 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc69192-0294-4277-97fb-3e63ffc01b86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61287b2-4ec2-482f-9554-cd6db9225cd0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)
Nov 14 18:02:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:03 user nova-compute[76161]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)
Nov 14 18:02:03 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0782d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d'): ({'sdg'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Removing single pathed devices sdg {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd786e54-330d-475a-ab5e-149351ff3cb4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[168269c0-bdef-4431-a105-1dda5209e604]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Flushing IO for device /dev/sdg {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d818340e-5517-4611-b800-c26b08f0b1c3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf975837-d477-471e-addb-0f805be40c4e]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] SCSI volumes sdg have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a8cb9-1eb2-4686-bd5f-52b4687ba26d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --logout" returned: 0 in 0.224s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aabf7c-c974-4274-9e4b-19e05dcf2ffc]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d, portal: 172.16.0.220,3260]
Nov 14 18:02:04 user nova-compute[76161]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d, portal: 172.16.0.220,3260] successful.
Nov 14 18:02:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f68c4d0-e901-4923-9396-26f374fe645d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dfcd2b-7d84-494c-9e33-83bd3db555d8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.492s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== disconnect_volume: return (493ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG nova.objects.instance [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-eac173c1-6de4-4fcc-9d4d-67910e438b4d tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.996s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:17 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1653be4a-11b6-43cb-996a-d759761c8411 is timed out.
Nov 14 18:02:17 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully detached device vdb from instance 1653be4a-11b6-43cb-996a-d759761c8411 from the live domain config.
Nov 14 18:02:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyXgChHW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:02:17 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4633ec-b0cf-4f6e-b089-bdbd5c075963]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:02:17 user nova-compute[76161]: No targets found.
Nov 14 18:02:17 user nova-compute[76161]: iSNS:
Nov 14 18:02:17 user nova-compute[76161]: No targets found.
Nov 14 18:02:17 user nova-compute[76161]: STATIC:
Nov 14 18:02:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f
Nov 14 18:02:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:02:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:02:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:02:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 18:02:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:17 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:02:17 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:17 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:17 user nova-compute[76161]: FIRMWARE:
Nov 14 18:02:17 user nova-compute[76161]: No targets found.
Nov 14 18:02:17 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:02:17 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:02:17 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef54e91-6dd7-4954-b763-5b31d9633736]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2cfe5a-8ad4-411c-9fa2-e2b804228dca]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:17 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:17 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:17 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:17 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:17 user nova-compute[76161]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)
Nov 14 18:02:17 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:17 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:17 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:17 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:17 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:17 user nova-compute[76161]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f (non-flash)
Nov 14 18:02:17 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f014d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f'): ({'sdi'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Removing single pathed devices sdi {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9295313-6043-4935-a218-788ce6008399]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b3f25d-5545-444c-a9a3-1cb41bae6e21]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flushing IO for device /dev/sdi {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1774ceb8-8641-46f0-9144-b27a865595d4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.062s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f18ed9-972f-4b9f-a5aa-8edebd653c8c]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] SCSI volumes sdi have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:02:17 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5101edc4-55e6-4142-a02d-9338efa0f310]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[de27746d-5638-41fe-81e8-8fc953190891]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f, portal: 172.16.0.220,3260]
Nov 14 18:02:18 user nova-compute[76161]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f, portal: 172.16.0.220,3260] successful.
Nov 14 18:02:18 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cefafe8-f42a-4486-bc92-93598024808f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a4ccf3-8e25-4c92-8593-87202d08182a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] <== disconnect_volume: return (366ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG nova.objects.instance [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'flavor' on Instance uuid 1653be4a-11b6-43cb-996a-d759761c8411 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3198f369-6932-42e8-9470-f4850815521c tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Updating instance_info_cache with network_info: [{"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:02:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:02:27 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:02:27 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=6907MB free_disk=25.061805725097656GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 75295499-8f99-4c9b-a556-c1287c61d8f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 385ef873-fc1f-46ae-90da-b75f82524b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance f8df16e2-c87f-432e-a639-f4d4931d9902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1653be4a-11b6-43cb-996a-d759761c8411 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0a5d3ce-4564-434d-9650-36548fb33ab0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance cd162511-a09b-4479-8d29-0a5a4b40ae78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance c6f53da9-e029-4aa7-8dad-edd41eb2eb5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:02:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:02:28 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:02:28 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:02:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:02:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "f8df16e2-c87f-432e-a639-f4d4931d9902" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:30 user nova-compute[76161]: INFO nova.compute.manager [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Terminating instance
Nov 14 18:02:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-598f7427-f40c-49fd-a977-509a23b693dc req-8868bef0-b7c1-4057-ba0a-408803e31951 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received event network-vif-unplugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-598f7427-f40c-49fd-a977-509a23b693dc req-8868bef0-b7c1-4057-ba0a-408803e31951 service nova] Acquiring lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-598f7427-f40c-49fd-a977-509a23b693dc req-8868bef0-b7c1-4057-ba0a-408803e31951 service nova] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-598f7427-f40c-49fd-a977-509a23b693dc req-8868bef0-b7c1-4057-ba0a-408803e31951 service nova] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-598f7427-f40c-49fd-a977-509a23b693dc req-8868bef0-b7c1-4057-ba0a-408803e31951 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] No waiting events found dispatching network-vif-unplugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:02:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-598f7427-f40c-49fd-a977-509a23b693dc req-8868bef0-b7c1-4057-ba0a-408803e31951 service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received event network-vif-unplugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:02:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Instance destroyed successfully.
Nov 14 18:02:31 user nova-compute[76161]: DEBUG nova.objects.instance [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lazy-loading 'resources' on Instance uuid f8df16e2-c87f-432e-a639-f4d4931d9902 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-90321100',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-90321100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9032110',id=33,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo7dqhfnJu0Dztv8ibR8N4Sq+F72M+JR6+7OzluphnrpmT06delzCOggQW1UCV+7Igscw2sJC+xrr3K0qWCgT6UggvZOVKX0+wFfl1D7T8hS9Jw0vckTVLUW7Ohlk7HbQ==',key_name='tempest-keypair-684407785',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92344de47ffa4a5883115469db09b283',ramdisk_id='',reservation_id='r-czenygfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-937613309',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cbac0f2bd224fc88b8b1bbb332fd793',uuid=f8df16e2-c87f-432e-a639-f4d4931d9902,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Converting VIF {"id": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "address": "fa:16:3e:d7:b7:11", "network": {"id": "90913d1b-1c61-41b9-b08b-31f15dce9ec2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-575249315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92344de47ffa4a5883115469db09b283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8b1015-35", "ovs_interfaceid": "ac8b1015-35a1-4861-ada7-d67db570f0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:b7:11,bridge_name='br-int',has_traffic_filtering=True,id=ac8b1015-35a1-4861-ada7-d67db570f0c2,network=Network(90913d1b-1c61-41b9-b08b-31f15dce9ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8b1015-35') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG os_vif [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:b7:11,bridge_name='br-int',has_traffic_filtering=True,id=ac8b1015-35a1-4861-ada7-d67db570f0c2,network=Network(90913d1b-1c61-41b9-b08b-31f15dce9ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8b1015-35') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac8b1015-35, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1bde732-3855-443e-a857-4439403ecead) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:02:31 user nova-compute[76161]: INFO os_vif [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:b7:11,bridge_name='br-int',has_traffic_filtering=True,id=ac8b1015-35a1-4861-ada7-d67db570f0c2,network=Network(90913d1b-1c61-41b9-b08b-31f15dce9ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8b1015-35')
Nov 14 18:02:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Deleting instance files /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902_del
Nov 14 18:02:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Deletion of /opt/stack/data/nova/instances/f8df16e2-c87f-432e-a639-f4d4931d9902_del complete
Nov 14 18:02:31 user nova-compute[76161]: INFO nova.compute.manager [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 18:02:31 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:02:31 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:02:32 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:02:32 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Took 1.10 seconds to deallocate network for instance.
Nov 14 18:02:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:32 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:02:32 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:02:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-a3e35156-ac1c-4ef4-a72f-e778dfccf385 req-b23e70eb-af3b-4a4a-a85a-0807f4927adf service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received event network-vif-plugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a3e35156-ac1c-4ef4-a72f-e778dfccf385 req-b23e70eb-af3b-4a4a-a85a-0807f4927adf service nova] Acquiring lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a3e35156-ac1c-4ef4-a72f-e778dfccf385 req-b23e70eb-af3b-4a4a-a85a-0807f4927adf service nova] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a3e35156-ac1c-4ef4-a72f-e778dfccf385 req-b23e70eb-af3b-4a4a-a85a-0807f4927adf service nova] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-a3e35156-ac1c-4ef4-a72f-e778dfccf385 req-b23e70eb-af3b-4a4a-a85a-0807f4927adf service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] No waiting events found dispatching network-vif-plugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:02:32 user nova-compute[76161]: WARNING nova.compute.manager [req-a3e35156-ac1c-4ef4-a72f-e778dfccf385 req-b23e70eb-af3b-4a4a-a85a-0807f4927adf service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received unexpected event network-vif-plugged-ac8b1015-35a1-4861-ada7-d67db570f0c2 for instance with vm_state deleted and task_state None.
Nov 14 18:02:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-a3e35156-ac1c-4ef4-a72f-e778dfccf385 req-b23e70eb-af3b-4a4a-a85a-0807f4927adf service nova] [instance: f8df16e2-c87f-432e-a639-f4d4931d9902] Received event network-vif-deleted-ac8b1015-35a1-4861-ada7-d67db570f0c2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:32 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Deleted allocations for instance f8df16e2-c87f-432e-a639-f4d4931d9902
Nov 14 18:02:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-99818f27-9f7a-498e-b2ca-d2845010655a tempest-TestServerVolumeAttachScenarioOldVersion-937613309 tempest-TestServerVolumeAttachScenarioOldVersion-937613309-project-member] Lock "f8df16e2-c87f-432e-a639-f4d4931d9902" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:35 user nova-compute[76161]: INFO nova.compute.manager [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attaching volume d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb to /dev/vdb
Nov 14 18:02:35 user nova-compute[76161]: DEBUG os_brick.utils [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e575392-5e54-4e4c-b67c-8469f450c265]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4f3385-ccb6-4029-a2b6-234c0b6db3b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f31ef3-96ab-4ea2-876a-d80461ed3488]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b985a76-6cff-406b-aa6f-8ade6b36c3c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:02:35 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:02:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daae01b-7fff-4d8f-bc3d-284313f1b896]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG os_brick.utils [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:02:35 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Updating existing volume attachment record: 04a6df71-5b5b-40af-8249-32b14a315fec {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:02:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:39 user nova-compute[76161]: INFO nova.compute.manager [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Rescuing
Nov 14 18:02:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:02:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquired lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:02:39 user nova-compute[76161]: DEBUG nova.network.neutron [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-4df29444-abd4-4145-8e57-7199138d8d81 req-0c879bcb-0ca2-4880-b633-59e588d31364 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received event network-changed-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-4df29444-abd4-4145-8e57-7199138d8d81 req-0c879bcb-0ca2-4880-b633-59e588d31364 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Refreshing instance network info cache due to event network-changed-f8e82122-b7bf-4a06-b5cc-084e959e2e11. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4df29444-abd4-4145-8e57-7199138d8d81 req-0c879bcb-0ca2-4880-b633-59e588d31364 service nova] Acquiring lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4df29444-abd4-4145-8e57-7199138d8d81 req-0c879bcb-0ca2-4880-b633-59e588d31364 service nova] Acquired lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG nova.network.neutron [req-4df29444-abd4-4145-8e57-7199138d8d81 req-0c879bcb-0ca2-4880-b633-59e588d31364 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Refreshing network info cache for port f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdwHhNjo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:02:40 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:02:40 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:02:40 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[87695d90-de42-4989-a1ed-3ed9acbf6d94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:02:40 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82e2ed9-3e4a-4dcf-a214-e0a7e1962a8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb] added
Nov 14 18:02:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Updating instance_info_cache with network_info: [{"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fa6662-9289-44b3-b7f1-885a954783ac]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Releasing lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece6cf3-0ad1-48a9-b7a8-63a1670f35eb]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdwHhNjo {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdwHhNjo" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8632b5cf-f70b-49fc-b1d9-be9e2cb6e389]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdwHhNjo'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15d7f0b-71ca-4173-b3ea-ed247d807e1c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[88841d3b-9dba-4296-96a7-75a3355b9197]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fbce3b-5574-4e4e-8164-9464c620e1b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb, portal: 172.16.0.220,3260]
Nov 14 18:02:40 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb, portal: 172.16.0.220,3260] successful.
Nov 14 18:02:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea20e66-2e20-45d5-9f76-a6280cd8d6fc]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b009e51-b5a8-4823-8819-c686ad252379]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:02:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:40 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:02:40 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.039s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23f171e-6df2-4276-9376-330072623af4]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdwHhNjo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-b48c8653-6016-40e7-9e27-2a23625bdb74 req-261222b7-f304-4ee9-9da9-ae73d6286997 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-unplugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b48c8653-6016-40e7-9e27-2a23625bdb74 req-261222b7-f304-4ee9-9da9-ae73d6286997 service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b48c8653-6016-40e7-9e27-2a23625bdb74 req-261222b7-f304-4ee9-9da9-ae73d6286997 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b48c8653-6016-40e7-9e27-2a23625bdb74 req-261222b7-f304-4ee9-9da9-ae73d6286997 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-b48c8653-6016-40e7-9e27-2a23625bdb74 req-261222b7-f304-4ee9-9da9-ae73d6286997 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-unplugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:02:40 user nova-compute[76161]: WARNING nova.compute.manager [req-b48c8653-6016-40e7-9e27-2a23625bdb74 req-261222b7-f304-4ee9-9da9-ae73d6286997 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-unplugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state active and task_state rescuing.
Nov 14 18:02:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:41 user nova-compute[76161]: DEBUG nova.network.neutron [req-4df29444-abd4-4145-8e57-7199138d8d81 req-0c879bcb-0ca2-4880-b633-59e588d31364 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updated VIF entry in instance network info cache for port f8e82122-b7bf-4a06-b5cc-084e959e2e11. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:02:41 user nova-compute[76161]: DEBUG nova.network.neutron [req-4df29444-abd4-4145-8e57-7199138d8d81 req-0c879bcb-0ca2-4880-b633-59e588d31364 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updating instance_info_cache with network_info: [{"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:02:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4df29444-abd4-4145-8e57-7199138d8d81 req-0c879bcb-0ca2-4880-b633-59e588d31364 service nova] Releasing lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:02:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Instance destroyed successfully.
Nov 14 18:02:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Attempting a stable device rescue
Nov 14 18:02:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76161) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 18:02:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Instance directory exists: not creating {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 18:02:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Creating image(s)
Nov 14 18:02:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "/opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "/opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:41 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'trusted_certs' on Instance uuid cd162511-a09b-4479-8d29-0a5a4b40ae78 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "31faef246a4fa94a17bba09ae19bdf70ce269448" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "31faef246a4fa94a17bba09ae19bdf70ce269448" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448.part --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.289s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== connect_volume: return (2292ms) {'type': 'block', 'scsi_wwn': '23366316363373634', 'path': '/dev/sde'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366316363373634', 'path': '/dev/sde'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-c5827878-4dae-4d83-879d-ffbdf80e9855 req-bfa668ef-27c0-4ee9-ba94-5f85d48f13ee service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-changed-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-c5827878-4dae-4d83-879d-ffbdf80e9855 req-bfa668ef-27c0-4ee9-ba94-5f85d48f13ee service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Refreshing instance network info cache due to event network-changed-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c5827878-4dae-4d83-879d-ffbdf80e9855 req-bfa668ef-27c0-4ee9-ba94-5f85d48f13ee service nova] Acquiring lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c5827878-4dae-4d83-879d-ffbdf80e9855 req-bfa668ef-27c0-4ee9-ba94-5f85d48f13ee service nova] Acquired lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG nova.network.neutron [req-c5827878-4dae-4d83-879d-ffbdf80e9855 req-bfa668ef-27c0-4ee9-ba94-5f85d48f13ee service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Refreshing network info cache for port a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:02:42 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:02:42 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:02:42 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:02:42 user nova-compute[76161]:   <serial>d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb</serial>
Nov 14 18:02:42 user nova-compute[76161]: </disk>
Nov 14 18:02:42 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448.part --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG nova.virt.images [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] 8c419b03-8802-43dd-9b65-13c3304571f8 was qcow2, converting to raw {{(pid=76161) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448.part /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448.converted {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-ffe1d61e-eec9-424e-a832-914cde6ba156 req-9e17b116-2898-4116-98f5-0aa584e50f48 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ffe1d61e-eec9-424e-a832-914cde6ba156 req-9e17b116-2898-4116-98f5-0aa584e50f48 service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ffe1d61e-eec9-424e-a832-914cde6ba156 req-9e17b116-2898-4116-98f5-0aa584e50f48 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ffe1d61e-eec9-424e-a832-914cde6ba156 req-9e17b116-2898-4116-98f5-0aa584e50f48 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-ffe1d61e-eec9-424e-a832-914cde6ba156 req-9e17b116-2898-4116-98f5-0aa584e50f48 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:02:42 user nova-compute[76161]: WARNING nova.compute.manager [req-ffe1d61e-eec9-424e-a832-914cde6ba156 req-9e17b116-2898-4116-98f5-0aa584e50f48 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state active and task_state rescuing.
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.compute.manager [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Stashing vm_state: active {{(pid=76161) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] No VIF found with MAC fa:16:3e:24:51:b7, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.network.neutron [req-c5827878-4dae-4d83-879d-ffbdf80e9855 req-bfa668ef-27c0-4ee9-ba94-5f85d48f13ee service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updated VIF entry in instance network info cache for port a4d4380d-a5c8-4a18-8255-7e256cc7c3f1. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.network.neutron [req-c5827878-4dae-4d83-879d-ffbdf80e9855 req-bfa668ef-27c0-4ee9-ba94-5f85d48f13ee service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating instance_info_cache with network_info: [{"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c5827878-4dae-4d83-879d-ffbdf80e9855 req-bfa668ef-27c0-4ee9-ba94-5f85d48f13ee service nova] Releasing lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:02:43 user nova-compute[76161]: INFO nova.compute.claims [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Claim successful on node user
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448.part /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448.converted" returned: 0 in 0.718s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448.converted --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:43 user nova-compute[76161]: INFO nova.compute.resource_tracker [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating resource usage from migration ca93d3c3-1e69-48f3-a14b-9d83f946cd0e
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e832232b-d0a3-4113-919a-3b3a08d9777e tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.269s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "31faef246a4fa94a17bba09ae19bdf70ce269448" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.336s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "31faef246a4fa94a17bba09ae19bdf70ce269448" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "31faef246a4fa94a17bba09ae19bdf70ce269448" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448 --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448,backing_fmt=raw /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448,backing_fmt=raw /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue" returned: 0 in 0.062s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "31faef246a4fa94a17bba09ae19bdf70ce269448" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'migration_context' on Instance uuid cd162511-a09b-4479-8d29-0a5a4b40ae78 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.objects.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Object Instance<cd162511-a09b-4479-8d29-0a5a4b40ae78> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Start _get_guest_xml network_info=[{"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "vif_mac": "fa:16:3e:be:d3:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8c419b03-8802-43dd-9b65-13c3304571f8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHKLVvmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'cd162511-a09b-4479-8d29-0a5a4b40ae78', 'attached_at': '', 'detached_at': '', 'volume_id': '80815466-0bc1-43dd-8a76-979ef49da369', 'serial': '80815466-0bc1-43dd-8a76-979ef49da369'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'f6a1c450-6bc1-4609-923d-c9c9fd3edd60', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'resources' on Instance uuid cd162511-a09b-4479-8d29-0a5a4b40ae78 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:43 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.objects.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Object Instance<cd162511-a09b-4479-8d29-0a5a4b40ae78> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'numa_topology' on Instance uuid cd162511-a09b-4479-8d29-0a5a4b40ae78 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.objects.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Object Instance<cd162511-a09b-4479-8d29-0a5a4b40ae78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:02:44 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:02:44 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'vcpu_model' on Instance uuid cd162511-a09b-4479-8d29-0a5a4b40ae78 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.717s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:44 user nova-compute[76161]: INFO nova.compute.manager [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Migrating
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.objects.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Object Instance<cd162511-a09b-4479-8d29-0a5a4b40ae78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHKLVvmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:02:44 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:02:44 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:02:44 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[db76f1c2-0d9d-4948-a155-4cff1f61e808]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pHKLVvmz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 18:02:44 user nova-compute[76161]: node.name = iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:02:44 user nova-compute[76161]: node.tpgt = -1
Nov 14 18:02:44 user nova-compute[76161]: node.startup = automatic
Nov 14 18:02:44 user nova-compute[76161]: node.leading_login = No
Nov 14 18:02:44 user nova-compute[76161]: iface.iscsi_ifacename = default
Nov 14 18:02:44 user nova-compute[76161]: iface.net_ifacename = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.ipaddress = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.prefix_len = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.hwaddress = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.transport_name = tcp
Nov 14 18:02:44 user nova-compute[76161]: iface.initiatorname = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.state = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.vlan_id = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.vlan_priority = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.vlan_state = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.iface_num = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.mtu = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.port = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.bootproto = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.subnet_mask = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.gateway = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.dhcp_alt_client_id = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.dhcp_dns = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.dhcp_learn_iqn = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.dhcp_vendor_id_state = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.dhcp_vendor_id = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.dhcp_slp_da = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.fragmentation = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.gratuitous_arp = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.incoming_forwarding = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.tos_state = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.tos = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.ttl = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.delayed_ack = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.tcp_nagle = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.tcp_wsf_state = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.tcp_wsf = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.tcp_timer_scale = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.tcp_timestamp = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.redirect = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.def_task_mgmt_timeout = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.header_digest = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.data_digest = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.immediate_data = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.initial_r2t = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.data_seq_inorder = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.data_pdu_inorder = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.erl = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.max_receive_data_len = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.first_burst_len = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.max_outstanding_r2t = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.max_burst_len = 0
Nov 14 18:02:44 user nova-compute[76161]: iface.chap_auth = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.bidi_chap = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.strict_login_compliance = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.discovery_auth = <empty>
Nov 14 18:02:44 user nova-compute[76161]: iface.discovery_logout = <empty>
Nov 14 18:02:44 user nova-compute[76161]: node.discovery_address = <empty>
Nov 14 18:02:44 user nova-compute[76161]: node.discovery_port = 0
Nov 14 18:02:44 user nova-compute[76161]: node.discovery_type = static
Nov 14 18:02:44 user nova-compute[76161]: node.session.initial_cmdsn = 0
Nov 14 18:02:44 user nova-compute[76161]: node.session.initial_login_retry_max = 8
Nov 14 18:02:44 user nova-compute[76161]: node.session.xmit_thread_priority = -20
Nov 14 18:02:44 user nova-compute[76161]: node.session.cmds_max = 128
Nov 14 18:02:44 user nova-compute[76161]: node.session.queue_depth = 32
Nov 14 18:02:44 user nova-compute[76161]: node.session.nr_sessions = 1
Nov 14 18:02:44 user nova-compute[76161]: node.session.auth.authmethod = CHAP
Nov 14 18:02:44 user nova-compute[76161]: node.session.auth.username = pHKLVvmz
Nov 14 18:02:44 user nova-compute[76161]: node.session.auth.password = ***
Nov 14 18:02:44 user nova-compute[76161]: node.session.auth.username_in = <empty>
Nov 14 18:02:44 user nova-compute[76161]: node.session.auth.password_in = <empty>
Nov 14 18:02:44 user nova-compute[76161]: node.session.auth.chap_algs = MD5
Nov 14 18:02:44 user nova-compute[76161]: node.session.timeo.replacement_timeout = 120
Nov 14 18:02:44 user nova-compute[76161]: node.session.err_timeo.abort_timeout = 15
Nov 14 18:02:44 user nova-compute[76161]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 18:02:44 user nova-compute[76161]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 18:02:44 user nova-compute[76161]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 18:02:44 user nova-compute[76161]: node.session.iscsi.FastAbort = Yes
Nov 14 18:02:44 user nova-compute[76161]: node.session.iscsi.InitialR2T = No
Nov 14 18:02:44 user nova-compute[76161]: node.session.iscsi.ImmediateData = Yes
Nov 14 18:02:44 user nova-compute[76161]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 18:02:44 user nova-compute[76161]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 18:02:44 user nova-compute[76161]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 18:02:44 user nova-compute[76161]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 18:02:44 user nova-compute[76161]: node.session.iscsi.MaxConnections = 1
Nov 14 18:02:44 user nova-compute[76161]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 18:02:44 user nova-compute[76161]: node.session.iscsi.ERL = 0
Nov 14 18:02:44 user nova-compute[76161]: node.session.scan = manual
Nov 14 18:02:44 user nova-compute[76161]: node.session.reopen_max = 0
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].address = 172.16.0.220
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].port = 3260
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].startup = manual
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].tcp.window_size = 524288
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].tcp.type_of_service = 0
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].timeo.logout_timeout = 15
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].timeo.login_timeout = 15
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].timeo.auth_timeout = 45
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].iscsi.DataDigest = None
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].iscsi.IFMarker = No
Nov 14 18:02:44 user nova-compute[76161]: node.conn[0].iscsi.OFMarker = No
Nov 14 18:02:44 user nova-compute[76161]: # END RECORD
Nov 14 18:02:44 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquired lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.network.neutron [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeb9330-7d9c-49c7-98b3-ae86100ec579]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f19c45-853d-440e-9dba-7dc69827d1aa]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHKLVvmz {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHKLVvmz" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64498dd-13eb-4866-8bd6-b4d68fc60cfe]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHKLVvmz'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b3e357-6e0c-4dcd-b164-439aae79a50b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[092bd4f3-f8ec-45d9-8ac9-dd5cd90ee018]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:44 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:44 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:44 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:44 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:44 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:02:44 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:44 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:44 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:44 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:44 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:44 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:02:44 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] HCTL ('34', '0', '0', 0) found on session 37 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ea78f0-7ece-421d-ae1b-0e7f011464c9]: (4, ('0 0 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Searching for a device in session 37 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHKLVvmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.188s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '23664633035326539', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664633035326539', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-431593191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-431593191',id=36,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-630lejpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:01:07Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=cd162511-a09b-4479-8d29-0a5a4b40ae78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "vif_mac": "fa:16:3e:be:d3:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "vif_mac": "fa:16:3e:be:d3:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:d3:16,bridge_name='br-int',has_traffic_filtering=True,id=23a82f81-d0bf-420c-a9f9-e8241d7524c5,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a82f81-d0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'pci_devices' on Instance uuid cd162511-a09b-4479-8d29-0a5a4b40ae78 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.objects.base [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Object Instance<cd162511-a09b-4479-8d29-0a5a4b40ae78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:02:44 user nova-compute[76161]:   <uuid>cd162511-a09b-4479-8d29-0a5a4b40ae78</uuid>
Nov 14 18:02:44 user nova-compute[76161]:   <name>instance-00000024</name>
Nov 14 18:02:44 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:02:44 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:02:44 user nova-compute[76161]:   <metadata>
Nov 14 18:02:44 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:02:44 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:02:44 user nova-compute[76161]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-431593191</nova:name>
Nov 14 18:02:44 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:02:44</nova:creationTime>
Nov 14 18:02:44 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:02:44 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:02:44 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:02:44 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:02:44 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:02:44 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:02:44 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:02:44 user nova-compute[76161]:       <nova:owner>
Nov 14 18:02:44 user nova-compute[76161]:         <nova:user uuid="4714975d06d8455788463a30e9bc5faa">tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member</nova:user>
Nov 14 18:02:44 user nova-compute[76161]:         <nova:project uuid="69696059b86f44b7ae274bf8274f9843">tempest-ServerBootFromVolumeStableRescueTest-500586355</nova:project>
Nov 14 18:02:44 user nova-compute[76161]:       </nova:owner>
Nov 14 18:02:44 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:02:44 user nova-compute[76161]:       <nova:ports>
Nov 14 18:02:44 user nova-compute[76161]:         <nova:port uuid="23a82f81-d0bf-420c-a9f9-e8241d7524c5">
Nov 14 18:02:44 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 18:02:44 user nova-compute[76161]:         </nova:port>
Nov 14 18:02:44 user nova-compute[76161]:       </nova:ports>
Nov 14 18:02:44 user nova-compute[76161]:     </nova:instance>
Nov 14 18:02:44 user nova-compute[76161]:   </metadata>
Nov 14 18:02:44 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:02:44 user nova-compute[76161]:     <system>
Nov 14 18:02:44 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:02:44 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:02:44 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:02:44 user nova-compute[76161]:       <entry name="serial">cd162511-a09b-4479-8d29-0a5a4b40ae78</entry>
Nov 14 18:02:44 user nova-compute[76161]:       <entry name="uuid">cd162511-a09b-4479-8d29-0a5a4b40ae78</entry>
Nov 14 18:02:44 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:02:44 user nova-compute[76161]:     </system>
Nov 14 18:02:44 user nova-compute[76161]:   </sysinfo>
Nov 14 18:02:44 user nova-compute[76161]:   <os>
Nov 14 18:02:44 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:02:44 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:02:44 user nova-compute[76161]:   </os>
Nov 14 18:02:44 user nova-compute[76161]:   <features>
Nov 14 18:02:44 user nova-compute[76161]:     <acpi/>
Nov 14 18:02:44 user nova-compute[76161]:     <apic/>
Nov 14 18:02:44 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:02:44 user nova-compute[76161]:   </features>
Nov 14 18:02:44 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:02:44 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:02:44 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:02:44 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:02:44 user nova-compute[76161]:   </clock>
Nov 14 18:02:44 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:02:44 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:02:44 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:02:44 user nova-compute[76161]:   </cpu>
Nov 14 18:02:44 user nova-compute[76161]:   <devices>
Nov 14 18:02:44 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:02:44 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:02:44 user nova-compute[76161]:       <source dev="/dev/sdc"/>
Nov 14 18:02:44 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:02:44 user nova-compute[76161]:       <serial>80815466-0bc1-43dd-8a76-979ef49da369</serial>
Nov 14 18:02:44 user nova-compute[76161]:     </disk>
Nov 14 18:02:44 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:02:44 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:02:44 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue"/>
Nov 14 18:02:44 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 18:02:44 user nova-compute[76161]:       <boot order="1"/>
Nov 14 18:02:44 user nova-compute[76161]:     </disk>
Nov 14 18:02:44 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:02:44 user nova-compute[76161]:       <mac address="fa:16:3e:be:d3:16"/>
Nov 14 18:02:44 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:02:44 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:02:44 user nova-compute[76161]:       <target dev="tap23a82f81-d0"/>
Nov 14 18:02:44 user nova-compute[76161]:     </interface>
Nov 14 18:02:44 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:02:44 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/console.log" append="off"/>
Nov 14 18:02:44 user nova-compute[76161]:     </serial>
Nov 14 18:02:44 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:02:44 user nova-compute[76161]:     <video>
Nov 14 18:02:44 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:02:44 user nova-compute[76161]:     </video>
Nov 14 18:02:44 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:02:44 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:02:44 user nova-compute[76161]:     </rng>
Nov 14 18:02:44 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:02:44 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:02:44 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:02:44 user nova-compute[76161]:     </memballoon>
Nov 14 18:02:44 user nova-compute[76161]:   </devices>
Nov 14 18:02:44 user nova-compute[76161]: </domain>
Nov 14 18:02:44 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:02:44 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Instance destroyed successfully.
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] No VIF found with MAC fa:16:3e:be:d3:16, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.network.neutron [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating instance_info_cache with network_info: [{"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Releasing lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Starting migrate_disk_and_power_off {{(pid=76161) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG nova.compute.manager [req-b768dc1a-560b-4c9c-ab89-e3ebc93e90d8 req-0372f239-793e-442d-8280-532da4f01039 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-vif-unplugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b768dc1a-560b-4c9c-ab89-e3ebc93e90d8 req-0372f239-793e-442d-8280-532da4f01039 service nova] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b768dc1a-560b-4c9c-ab89-e3ebc93e90d8 req-0372f239-793e-442d-8280-532da4f01039 service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b768dc1a-560b-4c9c-ab89-e3ebc93e90d8 req-0372f239-793e-442d-8280-532da4f01039 service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG nova.compute.manager [req-b768dc1a-560b-4c9c-ab89-e3ebc93e90d8 req-0372f239-793e-442d-8280-532da4f01039 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] No waiting events found dispatching network-vif-unplugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:02:45 user nova-compute[76161]: WARNING nova.compute.manager [req-b768dc1a-560b-4c9c-ab89-e3ebc93e90d8 req-0372f239-793e-442d-8280-532da4f01039 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received unexpected event network-vif-unplugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 for instance with vm_state active and task_state resize_migrating.
Nov 14 18:02:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:45 user nova-compute[76161]: INFO nova.compute.manager [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Detaching volume d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb
Nov 14 18:02:45 user nova-compute[76161]: INFO nova.virt.block_device [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Attempting to driver detach volume d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb from mountpoint /dev/vdb
Nov 14 18:02:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Attempting to detach device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:02:45 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:02:45 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:02:45 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:02:45 user nova-compute[76161]:   <serial>d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb</serial>
Nov 14 18:02:45 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:02:45 user nova-compute[76161]: </disk>
Nov 14 18:02:45 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:02:45 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Successfully detached device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the persistent domain config.
Nov 14 18:02:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:02:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:02:45 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:02:45 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:02:45 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:02:45 user nova-compute[76161]:   <serial>d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb</serial>
Nov 14 18:02:45 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:02:45 user nova-compute[76161]: </disk>
Nov 14 18:02:45 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG nova.compute.manager [req-8b5f64c7-2126-440a-8104-3ae246235227 req-0805fe14-13fc-4f56-81ce-34aa1df2fd2f service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8b5f64c7-2126-440a-8104-3ae246235227 req-0805fe14-13fc-4f56-81ce-34aa1df2fd2f service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8b5f64c7-2126-440a-8104-3ae246235227 req-0805fe14-13fc-4f56-81ce-34aa1df2fd2f service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8b5f64c7-2126-440a-8104-3ae246235227 req-0805fe14-13fc-4f56-81ce-34aa1df2fd2f service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG nova.compute.manager [req-8b5f64c7-2126-440a-8104-3ae246235227 req-0805fe14-13fc-4f56-81ce-34aa1df2fd2f service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:02:46 user nova-compute[76161]: WARNING nova.compute.manager [req-8b5f64c7-2126-440a-8104-3ae246235227 req-0805fe14-13fc-4f56-81ce-34aa1df2fd2f service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state active and task_state rescuing.
Nov 14 18:02:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Instance destroyed successfully.
Nov 14 18:02:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-927479785',display_name='tempest-ServerActionsTestOtherA-server-927479785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-927479785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/qLMrSixUeoWRNqyyMAmkr6Jdv4puUPBA23tnedByCcFoj2iOZE+ZPEXsuKk/6jLGW1AaCT9PLvxK/WjfaizeZDXI/isTmP1fIOMxcZKPA16ZEa+3fb0iod0Nl+OKmuw==',key_name='tempest-keypair-197899952',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:01:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-8sb5sxna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=a0a5d3ce-4564-434d-9650-36548fb33ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1890505256-network", "vif_mac": "fa:16:3e:4a:e7:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1890505256-network", "vif_mac": "fa:16:3e:4a:e7:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_vif [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4d4380d-a5, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc1a5854-5e87-4d18-bc9c-fa036026721a) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:02:46 user nova-compute[76161]: INFO os_vif [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5')
Nov 14 18:02:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmKOogtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:02:46 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0722c497-012a-4646-8446-1b66fd80b23a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:02:46 user nova-compute[76161]: No targets found.
Nov 14 18:02:46 user nova-compute[76161]: iSNS:
Nov 14 18:02:46 user nova-compute[76161]: No targets found.
Nov 14 18:02:46 user nova-compute[76161]: STATIC:
Nov 14 18:02:46 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:02:46 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:46 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:46 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:02:46 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:46 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:46 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:02:46 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:46 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:46 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 18:02:46 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:46 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:46 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:02:46 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:46 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:46 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb
Nov 14 18:02:46 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:02:46 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:02:46 user nova-compute[76161]: FIRMWARE:
Nov 14 18:02:46 user nova-compute[76161]: No targets found.
Nov 14 18:02:46 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:02:46 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:02:46 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.061s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cbf676-f32d-4fd1-b25b-4eb8d1ae9f6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e04b554-7bb5-4d54-8836-10f55bdd05e8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:46 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:46 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:46 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:46 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:46 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:02:46 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:46 user nova-compute[76161]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:46 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:46 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:46 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:46 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:02:46 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f81f9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe'): ({'sdf'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Removing single pathed devices sdf {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6358a03f-2ad1-4396-9a33-f58e51c83ad9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1cc426-b1b8-4326-af7e-fb07f41fa934]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flushing IO for device /dev/sdf {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8290bc-b64f-4d74-84fe-271addeb461a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6254105-c3ae-4204-a542-c2d1e71aa045]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:02:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f1a144-de39-44e5-839e-043ac2d46db2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbeedc5-49d4-4ebb-a210-e0c265f11312]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260]
Nov 14 18:02:47 user nova-compute[76161]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260] successful.
Nov 14 18:02:47 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf0bba8-b381-44e1-896d-c301daf3db05]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== disconnect_volume: return (425ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-8b6c9a12-87ec-4f36-92b3-f393d79082e2 req-e9bf4a63-bd5e-47c8-931a-b39f4c04bab2 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8b6c9a12-87ec-4f36-92b3-f393d79082e2 req-e9bf4a63-bd5e-47c8-931a-b39f4c04bab2 service nova] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8b6c9a12-87ec-4f36-92b3-f393d79082e2 req-e9bf4a63-bd5e-47c8-931a-b39f4c04bab2 service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8b6c9a12-87ec-4f36-92b3-f393d79082e2 req-e9bf4a63-bd5e-47c8-931a-b39f4c04bab2 service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-8b6c9a12-87ec-4f36-92b3-f393d79082e2 req-e9bf4a63-bd5e-47c8-931a-b39f4c04bab2 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] No waiting events found dispatching network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:02:47 user nova-compute[76161]: WARNING nova.compute.manager [req-8b6c9a12-87ec-4f36-92b3-f393d79082e2 req-e9bf4a63-bd5e-47c8-931a-b39f4c04bab2 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received unexpected event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 for instance with vm_state active and task_state resize_migrating.
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "1653be4a-11b6-43cb-996a-d759761c8411" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "1653be4a-11b6-43cb-996a-d759761c8411-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:47 user nova-compute[76161]: INFO nova.compute.manager [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Terminating instance
Nov 14 18:02:47 user nova-compute[76161]: DEBUG nova.compute.manager [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-14f19615-633c-401d-97fc-38333a2a1d51 req-9dd5faa4-a264-4ce0-9d86-7b9ae7a2e417 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received event network-vif-unplugged-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-14f19615-633c-401d-97fc-38333a2a1d51 req-9dd5faa4-a264-4ce0-9d86-7b9ae7a2e417 service nova] Acquiring lock "1653be4a-11b6-43cb-996a-d759761c8411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-14f19615-633c-401d-97fc-38333a2a1d51 req-9dd5faa4-a264-4ce0-9d86-7b9ae7a2e417 service nova] Lock "1653be4a-11b6-43cb-996a-d759761c8411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-14f19615-633c-401d-97fc-38333a2a1d51 req-9dd5faa4-a264-4ce0-9d86-7b9ae7a2e417 service nova] Lock "1653be4a-11b6-43cb-996a-d759761c8411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-14f19615-633c-401d-97fc-38333a2a1d51 req-9dd5faa4-a264-4ce0-9d86-7b9ae7a2e417 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] No waiting events found dispatching network-vif-unplugged-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:02:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-14f19615-633c-401d-97fc-38333a2a1d51 req-9dd5faa4-a264-4ce0-9d86-7b9ae7a2e417 service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received event network-vif-unplugged-d4512664-4563-48f2-bc29-c9a857f8577e for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.network.neutron [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Port a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 binding to destination host user is already ACTIVE {{(pid=76161) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-83a81236-eb81-4751-82e2-a5e326a499e5 req-48c0ee9d-922a-4458-aa50-3bd981d8b282 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-83a81236-eb81-4751-82e2-a5e326a499e5 req-48c0ee9d-922a-4458-aa50-3bd981d8b282 service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-83a81236-eb81-4751-82e2-a5e326a499e5 req-48c0ee9d-922a-4458-aa50-3bd981d8b282 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-83a81236-eb81-4751-82e2-a5e326a499e5 req-48c0ee9d-922a-4458-aa50-3bd981d8b282 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-83a81236-eb81-4751-82e2-a5e326a499e5 req-48c0ee9d-922a-4458-aa50-3bd981d8b282 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:02:48 user nova-compute[76161]: WARNING nova.compute.manager [req-83a81236-eb81-4751-82e2-a5e326a499e5 req-48c0ee9d-922a-4458-aa50-3bd981d8b282 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state active and task_state rescuing.
Nov 14 18:02:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:48 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Instance destroyed successfully.
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.objects.instance [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'resources' on Instance uuid 1653be4a-11b6-43cb-996a-d759761c8411 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-876742116',display_name='tempest-AttachVolumeNegativeTest-server-876742116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-876742116',id=34,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6rAF/2Zvnif1MTi0/VlVEsbmX8VSlUtPPMj6epBcYSQ2bdgx+NU7+k1qRZjcaRrmsqX31WqnLvby6cD0TEK1svh8ekWsHsIVjIDj9NcW+w3kFZgqCBzfYx8Sb+F06U7Q==',key_name='tempest-keypair-1492604258',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-yburnmt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=1653be4a-11b6-43cb-996a-d759761c8411,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "d4512664-4563-48f2-bc29-c9a857f8577e", "address": "fa:16:3e:6b:cc:f6", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4512664-45", "ovs_interfaceid": "d4512664-4563-48f2-bc29-c9a857f8577e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:cc:f6,bridge_name='br-int',has_traffic_filtering=True,id=d4512664-4563-48f2-bc29-c9a857f8577e,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4512664-45') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG os_vif [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:cc:f6,bridge_name='br-int',has_traffic_filtering=True,id=d4512664-4563-48f2-bc29-c9a857f8577e,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4512664-45') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4512664-45, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a027b48-06de-4122-bc29-b62b46b4315c) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:02:48 user nova-compute[76161]: INFO os_vif [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:cc:f6,bridge_name='br-int',has_traffic_filtering=True,id=d4512664-4563-48f2-bc29-c9a857f8577e,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4512664-45')
Nov 14 18:02:48 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Deleting instance files /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411_del
Nov 14 18:02:48 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Deletion of /opt/stack/data/nova/instances/1653be4a-11b6-43cb-996a-d759761c8411_del complete
Nov 14 18:02:48 user nova-compute[76161]: INFO nova.compute.manager [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 18:02:48 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquired lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.network.neutron [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:02:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-bdabdfc4-b21c-407a-9e77-82c0b438537d tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:02:49 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Took 1.00 seconds to deallocate network for instance.
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG nova.network.neutron [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating instance_info_cache with network_info: [{"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Releasing lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG os_brick.utils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b63d1e6-3d5e-4e5b-9415-167111316496]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d11342c-52fd-4349-9fe7-b34c08e516b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[47249d6d-bf3f-465e-b696-fbf5242c2bd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e075a3-1571-4e10-8699-195a037f4d50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:02:49 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2520c0a9-4f3e-4450-9d4b-17207db0d935]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG os_brick.utils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-b1f1617f-2a48-4df9-8fb3-56584e5b234b req-145cabec-2652-4b10-90b4-a2e9eaa8e24e service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received event network-vif-plugged-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b1f1617f-2a48-4df9-8fb3-56584e5b234b req-145cabec-2652-4b10-90b4-a2e9eaa8e24e service nova] Acquiring lock "1653be4a-11b6-43cb-996a-d759761c8411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b1f1617f-2a48-4df9-8fb3-56584e5b234b req-145cabec-2652-4b10-90b4-a2e9eaa8e24e service nova] Lock "1653be4a-11b6-43cb-996a-d759761c8411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b1f1617f-2a48-4df9-8fb3-56584e5b234b req-145cabec-2652-4b10-90b4-a2e9eaa8e24e service nova] Lock "1653be4a-11b6-43cb-996a-d759761c8411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-b1f1617f-2a48-4df9-8fb3-56584e5b234b req-145cabec-2652-4b10-90b4-a2e9eaa8e24e service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] No waiting events found dispatching network-vif-plugged-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:02:49 user nova-compute[76161]: WARNING nova.compute.manager [req-b1f1617f-2a48-4df9-8fb3-56584e5b234b req-145cabec-2652-4b10-90b4-a2e9eaa8e24e service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received unexpected event network-vif-plugged-d4512664-4563-48f2-bc29-c9a857f8577e for instance with vm_state deleted and task_state None.
Nov 14 18:02:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-b1f1617f-2a48-4df9-8fb3-56584e5b234b req-145cabec-2652-4b10-90b4-a2e9eaa8e24e service nova] [instance: 1653be4a-11b6-43cb-996a-d759761c8411] Received event network-vif-deleted-d4512664-4563-48f2-bc29-c9a857f8577e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:50 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Deleted allocations for instance 1653be4a-11b6-43cb-996a-d759761c8411
Nov 14 18:02:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:50 user nova-compute[76161]: INFO nova.compute.manager [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Unshelving
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fd024f08-2732-41e1-aa49-d04d55ff2f66 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "1653be4a-11b6-43cb-996a-d759761c8411" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.827s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:50 user nova-compute[76161]: INFO nova.virt.block_device [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Booting with volume bf6ef675-607c-45f6-866c-f74f687b5065 at /dev/vdc
Nov 14 18:02:50 user nova-compute[76161]: DEBUG os_brick.utils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff7e72a-8491-4401-bda9-86160cf6a3af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4578ba3f-f2c8-4620-b5d7-bab2713f9194]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8c8fb6-e29e-4cda-8c05-89e9a02e8fbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d3be6e-321c-4f6e-b4f0-8eb68a37efd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:02:50 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:02:50 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a32420c-c3c7-49dc-a81c-369e724a7d49]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG os_brick.utils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updating existing volume attachment record: 23fdf465-c525-4033-ab57-826427468b92 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:02:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:52 user nova-compute[76161]: INFO nova.compute.manager [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Detaching volume b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:02:53 user nova-compute[76161]: INFO nova.virt.block_device [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Attempting to driver detach volume b0aadcea-0bc4-46b4-b4a5-77abc43079a8 from mountpoint /dev/vdb
Nov 14 18:02:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Attempting to detach device vdb from instance 75295499-8f99-4c9b-a556-c1287c61d8f2 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:02:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:02:53 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:02:53 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:02:53 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:02:53 user nova-compute[76161]:   <serial>b0aadcea-0bc4-46b4-b4a5-77abc43079a8</serial>
Nov 14 18:02:53 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 18:02:53 user nova-compute[76161]: </disk>
Nov 14 18:02:53 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:02:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully detached device vdb from instance 75295499-8f99-4c9b-a556-c1287c61d8f2 from the persistent domain config.
Nov 14 18:02:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75295499-8f99-4c9b-a556-c1287c61d8f2 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:02:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:02:53 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:02:53 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:02:53 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:02:53 user nova-compute[76161]:   <serial>b0aadcea-0bc4-46b4-b4a5-77abc43079a8</serial>
Nov 14 18:02:53 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 18:02:53 user nova-compute[76161]: </disk>
Nov 14 18:02:53 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:02:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Starting finish_migration {{(pid=76161) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Instance directory exists: not creating {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 18:02:55 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Creating image(s)
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Ensure instance console log exists: /opt/stack/data/nova/instances/a0a5d3ce-4564-434d-9650-36548fb33ab0/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Start _get_guest_xml network_info=[{"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1890505256-network", "vif_mac": "fa:16:3e:4a:e7:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmKOogtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a0a5d3ce-4564-434d-9650-36548fb33ab0', 'attached_at': '2023-11-14T18:02:55.000000', 'detached_at': '', 'volume_id': '6101ad26-b308-4342-b713-180af5bf40fe', 'serial': '6101ad26-b308-4342-b713-180af5bf40fe'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'a8ee51d5-d848-4d84-95ac-bca0bf615729', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:02:55 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:02:55 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmKOogtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:02:55 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:02:55 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:02:55 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac33c1d-f998-4f75-ad1b-e27498179de1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:02:55 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb439d2-4297-471f-81aa-4b378f1a07cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe] added
Nov 14 18:02:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfb14ee-ee2d-49fc-acc8-9959bd0d1e5d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d20f326-bcee-418e-bc78-3739c0085fe6]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rmKOogtc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'pci_requests' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rmKOogtc" returned: 0 in 0.038s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9b7b92-f36b-4c7e-a145-666ea48e6702]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rmKOogtc'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'numa_topology' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[696bcded-dc55-47a9-ba75-975323efe379]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:02:55 user nova-compute[76161]: INFO nova.compute.claims [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Claim successful on node user
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925bb57-9115-4c0b-91f6-32a5956e6463]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:02:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:02:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e58fe0-bf91-44a8-98e0-461f58e16e1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260]
Nov 14 18:02:55 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260] successful.
Nov 14 18:02:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[511e47a6-fbe7-4740-abd5-b8c77f12de8b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdf8bad-7e56-4955-8564-25b89bf935ba]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:02:55 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:02:55 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c1a170-e4ab-4155-b37f-0b849c0022d1]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:02:55 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmKOogtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:56 user nova-compute[76161]: INFO nova.network.neutron [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updating port 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquired lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.network.neutron [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-56048c19-6f85-4945-a66d-78f7ece29ecf req-29416f74-0ec0-45cb-82cf-7e6d226c5056 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-changed-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-56048c19-6f85-4945-a66d-78f7ece29ecf req-29416f74-0ec0-45cb-82cf-7e6d226c5056 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Refreshing instance network info cache due to event network-changed-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-56048c19-6f85-4945-a66d-78f7ece29ecf req-29416f74-0ec0-45cb-82cf-7e6d226c5056 service nova] Acquiring lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23534346133623238', 'path': '/dev/sdf'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534346133623238', 'path': '/dev/sdf'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-927479785',display_name='tempest-ServerActionsTestOtherA-server-927479785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-927479785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/qLMrSixUeoWRNqyyMAmkr6Jdv4puUPBA23tnedByCcFoj2iOZE+ZPEXsuKk/6jLGW1AaCT9PLvxK/WjfaizeZDXI/isTmP1fIOMxcZKPA16ZEa+3fb0iod0Nl+OKmuw==',key_name='tempest-keypair-197899952',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:01:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-8sb5sxna',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=a0a5d3ce-4564-434d-9650-36548fb33ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1890505256-network", "vif_mac": "fa:16:3e:4a:e7:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1890505256-network", "vif_mac": "fa:16:3e:4a:e7:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:02:56 user nova-compute[76161]:   <uuid>a0a5d3ce-4564-434d-9650-36548fb33ab0</uuid>
Nov 14 18:02:56 user nova-compute[76161]:   <name>instance-00000023</name>
Nov 14 18:02:56 user nova-compute[76161]:   <memory>2097152</memory>
Nov 14 18:02:56 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:02:56 user nova-compute[76161]:   <metadata>
Nov 14 18:02:56 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:02:56 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:02:56 user nova-compute[76161]:       <nova:name>tempest-ServerActionsTestOtherA-server-927479785</nova:name>
Nov 14 18:02:56 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:02:55</nova:creationTime>
Nov 14 18:02:56 user nova-compute[76161]:       <nova:flavor name="m1.small">
Nov 14 18:02:56 user nova-compute[76161]:         <nova:memory>2048</nova:memory>
Nov 14 18:02:56 user nova-compute[76161]:         <nova:disk>20</nova:disk>
Nov 14 18:02:56 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:02:56 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:02:56 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:02:56 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:02:56 user nova-compute[76161]:       <nova:owner>
Nov 14 18:02:56 user nova-compute[76161]:         <nova:user uuid="bbfeb35beb394e15bf881780f69724f6">tempest-ServerActionsTestOtherA-233736107-project-member</nova:user>
Nov 14 18:02:56 user nova-compute[76161]:         <nova:project uuid="4467aca672a34c1a8f4e1735636d311b">tempest-ServerActionsTestOtherA-233736107</nova:project>
Nov 14 18:02:56 user nova-compute[76161]:       </nova:owner>
Nov 14 18:02:56 user nova-compute[76161]:       <nova:ports>
Nov 14 18:02:56 user nova-compute[76161]:         <nova:port uuid="a4d4380d-a5c8-4a18-8255-7e256cc7c3f1">
Nov 14 18:02:56 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 18:02:56 user nova-compute[76161]:         </nova:port>
Nov 14 18:02:56 user nova-compute[76161]:       </nova:ports>
Nov 14 18:02:56 user nova-compute[76161]:     </nova:instance>
Nov 14 18:02:56 user nova-compute[76161]:   </metadata>
Nov 14 18:02:56 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:02:56 user nova-compute[76161]:     <system>
Nov 14 18:02:56 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:02:56 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:02:56 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:02:56 user nova-compute[76161]:       <entry name="serial">a0a5d3ce-4564-434d-9650-36548fb33ab0</entry>
Nov 14 18:02:56 user nova-compute[76161]:       <entry name="uuid">a0a5d3ce-4564-434d-9650-36548fb33ab0</entry>
Nov 14 18:02:56 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:02:56 user nova-compute[76161]:     </system>
Nov 14 18:02:56 user nova-compute[76161]:   </sysinfo>
Nov 14 18:02:56 user nova-compute[76161]:   <os>
Nov 14 18:02:56 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:02:56 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:02:56 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:02:56 user nova-compute[76161]:   </os>
Nov 14 18:02:56 user nova-compute[76161]:   <features>
Nov 14 18:02:56 user nova-compute[76161]:     <acpi/>
Nov 14 18:02:56 user nova-compute[76161]:     <apic/>
Nov 14 18:02:56 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:02:56 user nova-compute[76161]:   </features>
Nov 14 18:02:56 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:02:56 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:02:56 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:02:56 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:02:56 user nova-compute[76161]:   </clock>
Nov 14 18:02:56 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:02:56 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:02:56 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:02:56 user nova-compute[76161]:   </cpu>
Nov 14 18:02:56 user nova-compute[76161]:   <devices>
Nov 14 18:02:56 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:02:56 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:02:56 user nova-compute[76161]:       <source dev="/dev/sdf"/>
Nov 14 18:02:56 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:02:56 user nova-compute[76161]:       <serial>6101ad26-b308-4342-b713-180af5bf40fe</serial>
Nov 14 18:02:56 user nova-compute[76161]:     </disk>
Nov 14 18:02:56 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:02:56 user nova-compute[76161]:       <mac address="fa:16:3e:4a:e7:94"/>
Nov 14 18:02:56 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:02:56 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:02:56 user nova-compute[76161]:       <target dev="tapa4d4380d-a5"/>
Nov 14 18:02:56 user nova-compute[76161]:     </interface>
Nov 14 18:02:56 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:02:56 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/a0a5d3ce-4564-434d-9650-36548fb33ab0/console.log" append="off"/>
Nov 14 18:02:56 user nova-compute[76161]:     </serial>
Nov 14 18:02:56 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:02:56 user nova-compute[76161]:     <video>
Nov 14 18:02:56 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:02:56 user nova-compute[76161]:     </video>
Nov 14 18:02:56 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:02:56 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:02:56 user nova-compute[76161]:     </rng>
Nov 14 18:02:56 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:02:56 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:02:56 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:02:56 user nova-compute[76161]:     </memballoon>
Nov 14 18:02:56 user nova-compute[76161]:   </devices>
Nov 14 18:02:56 user nova-compute[76161]: </domain>
Nov 14 18:02:56 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-927479785',display_name='tempest-ServerActionsTestOtherA-server-927479785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-927479785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/qLMrSixUeoWRNqyyMAmkr6Jdv4puUPBA23tnedByCcFoj2iOZE+ZPEXsuKk/6jLGW1AaCT9PLvxK/WjfaizeZDXI/isTmP1fIOMxcZKPA16ZEa+3fb0iod0Nl+OKmuw==',key_name='tempest-keypair-197899952',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:01:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-8sb5sxna',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=a0a5d3ce-4564-434d-9650-36548fb33ab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1890505256-network", "vif_mac": "fa:16:3e:4a:e7:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1890505256-network", "vif_mac": "fa:16:3e:4a:e7:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG os_vif [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '996fb984-8428-5b47-8640-d3897f190542', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4d4380d-a5, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4d4380d-a5, col_values=(('qos', UUID('f51fd394-bdd3-4a0c-843d-dae3a58ab536')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4d4380d-a5, col_values=(('external_ids', {'iface-id': 'a4d4380d-a5c8-4a18-8255-7e256cc7c3f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:e7:94', 'vm-uuid': 'a0a5d3ce-4564-434d-9650-36548fb33ab0'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:56 user nova-compute[76161]: INFO os_vif [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5')
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:02:56 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] No VIF found with MAC fa:16:3e:4a:e7:94, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG nova.network.neutron [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updating instance_info_cache with network_info: [{"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Releasing lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:02:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Creating image(s)
Nov 14 18:02:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "/opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "/opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "/opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'trusted_certs' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-56048c19-6f85-4945-a66d-78f7ece29ecf req-29416f74-0ec0-45cb-82cf-7e6d226c5056 service nova] Acquired lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG nova.network.neutron [req-56048c19-6f85-4945-a66d-78f7ece29ecf req-29416f74-0ec0-45cb-82cf-7e6d226c5056 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Refreshing network info cache for port 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG nova.objects.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Object Instance<72ea8ec0-29d3-49f1-bd61-7047aabfbaff> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "5921006b6b6cb56100d3cac40fb892c5d6b85473" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "5921006b6b6cb56100d3cac40fb892c5d6b85473" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473.part --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473.part --force-share --output=json" returned: 0 in 0.213s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG nova.virt.images [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] bcedc9eb-1818-47de-ad98-5dbd9af93102 was qcow2, converting to raw {{(pid=76161) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473.part /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473.converted {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG nova.network.neutron [req-56048c19-6f85-4945-a66d-78f7ece29ecf req-29416f74-0ec0-45cb-82cf-7e6d226c5056 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updated VIF entry in instance network info cache for port 61e4ef5f-6fe5-430d-aeb6-af8dfa723f53. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG nova.network.neutron [req-56048c19-6f85-4945-a66d-78f7ece29ecf req-29416f74-0ec0-45cb-82cf-7e6d226c5056 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updating instance_info_cache with network_info: [{"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-56048c19-6f85-4945-a66d-78f7ece29ecf req-29416f74-0ec0-45cb-82cf-7e6d226c5056 service nova] Releasing lock "refresh_cache-72ea8ec0-29d3-49f1-bd61-7047aabfbaff" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473.part /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473.converted" returned: 0 in 0.298s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473.converted --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "5921006b6b6cb56100d3cac40fb892c5d6b85473" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.808s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473 --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "5921006b6b6cb56100d3cac40fb892c5d6b85473" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "5921006b6b6cb56100d3cac40fb892c5d6b85473" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473 --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473,backing_fmt=raw /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473,backing_fmt=raw /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk 1073741824" returned: 0 in 0.063s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "5921006b6b6cb56100d3cac40fb892c5d6b85473" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473 --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'migration_context' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG nova.objects.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Object Instance<72ea8ec0-29d3-49f1-bd61-7047aabfbaff> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:02:59 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Rebasing disk image.
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:02:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d -F raw /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:03:00 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Instance running successfully.
Nov 14 18:03:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Failed to set time: agent not configured {{(pid=76161) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 18:03:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-239f7b48-f130-4865-bea5-5a956d4b7f2f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] finish_migration finished successfully. {{(pid=76161) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 18:03:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-e4557a3c-99af-4bdd-943a-e2aa41040475 req-68d529a5-41c1-434b-abc2-9dfdef3eaf6b service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e4557a3c-99af-4bdd-943a-e2aa41040475 req-68d529a5-41c1-434b-abc2-9dfdef3eaf6b service nova] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e4557a3c-99af-4bdd-943a-e2aa41040475 req-68d529a5-41c1-434b-abc2-9dfdef3eaf6b service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e4557a3c-99af-4bdd-943a-e2aa41040475 req-68d529a5-41c1-434b-abc2-9dfdef3eaf6b service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-e4557a3c-99af-4bdd-943a-e2aa41040475 req-68d529a5-41c1-434b-abc2-9dfdef3eaf6b service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] No waiting events found dispatching network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:01 user nova-compute[76161]: WARNING nova.compute.manager [req-e4557a3c-99af-4bdd-943a-e2aa41040475 req-68d529a5-41c1-434b-abc2-9dfdef3eaf6b service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received unexpected event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 for instance with vm_state resized and task_state None.
Nov 14 18:03:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d -F raw /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk" returned: 0 in 2.603s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Ensure instance console log exists: /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Start _get_guest_xml network_info=[{"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='5a5b53a58a33e6c2258f612c0080a068',container_format='bare',created_at=2023-11-14T18:00:57Z,direct_url=<?>,disk_format='qcow2',id=bcedc9eb-1818-47de-ad98-5dbd9af93102,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1148321708-shelved',owner='3e77e9d3740940e6b3c3bbcb66281cdd',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T18:01:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObUnwLTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '72ea8ec0-29d3-49f1-bd61-7047aabfbaff', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf6ef675-607c-45f6-866c-f74f687b5065', 'serial': 'bf6ef675-607c-45f6-866c-f74f687b5065'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '23fdf465-c525-4033-ab57-826427468b92', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:03:02 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:03:02 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5a5b53a58a33e6c2258f612c0080a068',container_format='bare',created_at=2023-11-14T18:00:57Z,direct_url=<?>,disk_format='qcow2',id=bcedc9eb-1818-47de-ad98-5dbd9af93102,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1148321708-shelved',owner='3e77e9d3740940e6b3c3bbcb66281cdd',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T18:01:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'vcpu_model' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.objects.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Object Instance<72ea8ec0-29d3-49f1-bd61-7047aabfbaff> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObUnwLTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:03:02 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:03:02 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:03:02 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260" returned: 21 in 0.043s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa8cbea-e9ff-4880-8b38-0dcb9b74f184]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:03:02 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba0b5e6-f920-46e9-bbb3-94efcf9cf7d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065] added
Nov 14 18:03:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[567ab8ac-2309-4c0d-86f0-4acbff07d62b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7badd66-9d76-4166-acf3-45f5ae64b3f1]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ObUnwLTi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ObUnwLTi" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eca1466-a24d-4166-a3a6-427ab4f7883b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ObUnwLTi'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[609f0505-e1f5-4667-8d38-554aec7027f2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7375fd-6fb9-442b-a67a-b6bcd718731c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78cbeae-814f-42cc-aa6c-aa4d676fa3cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065, portal: 172.16.0.220,3260]
Nov 14 18:03:02 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065, portal: 172.16.0.220,3260] successful.
Nov 14 18:03:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6093ba-59d8-432a-a53f-6d2f72cc045a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fb6642-3905-42d1-974f-83ecbeba1a53]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:02 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:02 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] HCTL ('38', '-', '-', 0) found on session 45 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[514a680d-e226-4a0b-8a6a-738628aac2ec]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Searching for a device in session 45 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:03:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObUnwLTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-3428f2fb-1532-47e0-8572-60fea5aa48c1 req-db1aff75-6661-4930-9c9c-48cbff28b2cf service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3428f2fb-1532-47e0-8572-60fea5aa48c1 req-db1aff75-6661-4930-9c9c-48cbff28b2cf service nova] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3428f2fb-1532-47e0-8572-60fea5aa48c1 req-db1aff75-6661-4930-9c9c-48cbff28b2cf service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3428f2fb-1532-47e0-8572-60fea5aa48c1 req-db1aff75-6661-4930-9c9c-48cbff28b2cf service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-3428f2fb-1532-47e0-8572-60fea5aa48c1 req-db1aff75-6661-4930-9c9c-48cbff28b2cf service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] No waiting events found dispatching network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:03 user nova-compute[76161]: WARNING nova.compute.manager [req-3428f2fb-1532-47e0-8572-60fea5aa48c1 req-db1aff75-6661-4930-9c9c-48cbff28b2cf service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received unexpected event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 for instance with vm_state resized and task_state None.
Nov 14 18:03:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '26434613839343537', 'path': '/dev/sdg'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434613839343537', 'path': '/dev/sdg'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1148321708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1148321708',id=32,image_ref='bcedc9eb-1818-47de-ad98-5dbd9af93102',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-926458659',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-fw12nx7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member',shelved_at='2023-11-14T18:01:02.593459',shelved_host='user',shelved_image_id='bcedc9eb-1818-47de-ad98-5dbd9af93102'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=72ea8ec0-29d3-49f1-bd61-7047aabfbaff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'pci_devices' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.objects.base [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Object Instance<72ea8ec0-29d3-49f1-bd61-7047aabfbaff> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:03:03 user nova-compute[76161]:   <uuid>72ea8ec0-29d3-49f1-bd61-7047aabfbaff</uuid>
Nov 14 18:03:03 user nova-compute[76161]:   <name>instance-00000020</name>
Nov 14 18:03:03 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:03:03 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:03:03 user nova-compute[76161]:   <metadata>
Nov 14 18:03:03 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:03:03 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:03:03 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1148321708</nova:name>
Nov 14 18:03:03 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:03:02</nova:creationTime>
Nov 14 18:03:03 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:03:03 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:03:03 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:03:03 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:03:03 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:03:03 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:03:03 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:03:03 user nova-compute[76161]:       <nova:owner>
Nov 14 18:03:03 user nova-compute[76161]:         <nova:user uuid="cee653d6630641b89a074a31d8ddddbc">tempest-AttachVolumeShelveTestJSON-1624203066-project-member</nova:user>
Nov 14 18:03:03 user nova-compute[76161]:         <nova:project uuid="3e77e9d3740940e6b3c3bbcb66281cdd">tempest-AttachVolumeShelveTestJSON-1624203066</nova:project>
Nov 14 18:03:03 user nova-compute[76161]:       </nova:owner>
Nov 14 18:03:03 user nova-compute[76161]:       <nova:root type="image" uuid="bcedc9eb-1818-47de-ad98-5dbd9af93102"/>
Nov 14 18:03:03 user nova-compute[76161]:       <nova:ports>
Nov 14 18:03:03 user nova-compute[76161]:         <nova:port uuid="61e4ef5f-6fe5-430d-aeb6-af8dfa723f53">
Nov 14 18:03:03 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 18:03:03 user nova-compute[76161]:         </nova:port>
Nov 14 18:03:03 user nova-compute[76161]:       </nova:ports>
Nov 14 18:03:03 user nova-compute[76161]:     </nova:instance>
Nov 14 18:03:03 user nova-compute[76161]:   </metadata>
Nov 14 18:03:03 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:03:03 user nova-compute[76161]:     <system>
Nov 14 18:03:03 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:03:03 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:03:03 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:03:03 user nova-compute[76161]:       <entry name="serial">72ea8ec0-29d3-49f1-bd61-7047aabfbaff</entry>
Nov 14 18:03:03 user nova-compute[76161]:       <entry name="uuid">72ea8ec0-29d3-49f1-bd61-7047aabfbaff</entry>
Nov 14 18:03:03 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:03:03 user nova-compute[76161]:     </system>
Nov 14 18:03:03 user nova-compute[76161]:   </sysinfo>
Nov 14 18:03:03 user nova-compute[76161]:   <os>
Nov 14 18:03:03 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:03:03 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:03:03 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:03:03 user nova-compute[76161]:   </os>
Nov 14 18:03:03 user nova-compute[76161]:   <features>
Nov 14 18:03:03 user nova-compute[76161]:     <acpi/>
Nov 14 18:03:03 user nova-compute[76161]:     <apic/>
Nov 14 18:03:03 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:03:03 user nova-compute[76161]:   </features>
Nov 14 18:03:03 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:03:03 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:03:03 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:03:03 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:03:03 user nova-compute[76161]:   </clock>
Nov 14 18:03:03 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:03:03 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:03:03 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:03:03 user nova-compute[76161]:   </cpu>
Nov 14 18:03:03 user nova-compute[76161]:   <devices>
Nov 14 18:03:03 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:03:03 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:03:03 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk"/>
Nov 14 18:03:03 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:03:03 user nova-compute[76161]:     </disk>
Nov 14 18:03:03 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:03:03 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:03:03 user nova-compute[76161]:       <source dev="/dev/sdg"/>
Nov 14 18:03:03 user nova-compute[76161]:       <target dev="vdc" bus="virtio"/>
Nov 14 18:03:03 user nova-compute[76161]:       <serial>bf6ef675-607c-45f6-866c-f74f687b5065</serial>
Nov 14 18:03:03 user nova-compute[76161]:     </disk>
Nov 14 18:03:03 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:03:03 user nova-compute[76161]:       <mac address="fa:16:3e:b2:ce:91"/>
Nov 14 18:03:03 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:03:03 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:03:03 user nova-compute[76161]:       <target dev="tap61e4ef5f-6f"/>
Nov 14 18:03:03 user nova-compute[76161]:     </interface>
Nov 14 18:03:03 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:03:03 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/console.log" append="off"/>
Nov 14 18:03:03 user nova-compute[76161]:     </serial>
Nov 14 18:03:03 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:03:03 user nova-compute[76161]:     <video>
Nov 14 18:03:03 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:03:03 user nova-compute[76161]:     </video>
Nov 14 18:03:03 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:03:03 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:03:03 user nova-compute[76161]:     </rng>
Nov 14 18:03:03 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:03:03 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:03:03 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:03:03 user nova-compute[76161]:     </memballoon>
Nov 14 18:03:03 user nova-compute[76161]:   </devices>
Nov 14 18:03:03 user nova-compute[76161]: </domain>
Nov 14 18:03:03 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1148321708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1148321708',id=32,image_ref='bcedc9eb-1818-47de-ad98-5dbd9af93102',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-926458659',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-fw12nx7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member',shelved_at='2023-11-14T18:01:02.593459',shelved_host='user',shelved_image_id='bcedc9eb-1818-47de-ad98-5dbd9af93102'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=72ea8ec0-29d3-49f1-bd61-7047aabfbaff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG os_vif [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6070822-d064-527e-bda5-3c83301218c2', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61e4ef5f-6f, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61e4ef5f-6f, col_values=(('qos', UUID('d0e1cfae-1859-4012-baea-2139912356c2')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61e4ef5f-6f, col_values=(('external_ids', {'iface-id': '61e4ef5f-6fe5-430d-aeb6-af8dfa723f53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ce:91', 'vm-uuid': '72ea8ec0-29d3-49f1-bd61-7047aabfbaff'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:03:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:03 user nova-compute[76161]: INFO os_vif [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f')
Nov 14 18:03:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:03:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:03:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] No VIF found with MAC fa:16:3e:b2:ce:91, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:03:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-7bdbeb3d-68fd-48c4-9f30-bc3a4602fde4 req-a7c10129-2052-4711-9a71-caa4c9ac5232 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7bdbeb3d-68fd-48c4-9f30-bc3a4602fde4 req-a7c10129-2052-4711-9a71-caa4c9ac5232 service nova] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7bdbeb3d-68fd-48c4-9f30-bc3a4602fde4 req-a7c10129-2052-4711-9a71-caa4c9ac5232 service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7bdbeb3d-68fd-48c4-9f30-bc3a4602fde4 req-a7c10129-2052-4711-9a71-caa4c9ac5232 service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-7bdbeb3d-68fd-48c4-9f30-bc3a4602fde4 req-a7c10129-2052-4711-9a71-caa4c9ac5232 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] No waiting events found dispatching network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:05 user nova-compute[76161]: WARNING nova.compute.manager [req-7bdbeb3d-68fd-48c4-9f30-bc3a4602fde4 req-a7c10129-2052-4711-9a71-caa4c9ac5232 service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received unexpected event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 18:03:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:06 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 is timed out.
Nov 14 18:03:06 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Successfully detached device vdb from instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 from the live domain config.
Nov 14 18:03:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdwHhNjo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:03:06 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f65fc0d-09b5-48d5-9115-2b34c5270ac1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:03:06 user nova-compute[76161]: No targets found.
Nov 14 18:03:06 user nova-compute[76161]: iSNS:
Nov 14 18:03:06 user nova-compute[76161]: No targets found.
Nov 14 18:03:06 user nova-compute[76161]: STATIC:
Nov 14 18:03:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:03:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:03:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:03:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 18:03:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:03:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065
Nov 14 18:03:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:06 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb
Nov 14 18:03:06 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:06 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:06 user nova-compute[76161]: FIRMWARE:
Nov 14 18:03:06 user nova-compute[76161]: No targets found.
Nov 14 18:03:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:03:06 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:03:06 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab64abc3-f550-4e10-816d-a2b75d0ed67c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[86008dcd-1970-4bcd-95db-424a0543303b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:06 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f013b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb'): ({'sde'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Removing single pathed devices sde {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[550c8b4c-5e93-4237-a681-744ff4756f0a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6ea1fd-b661-4046-9390-b4b3bd97bd9d]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Flushing IO for device /dev/sde {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aa63a1-d58d-450d-89d7-8639d399139f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1821d3bf-ccf1-4e7b-9e2a-f1edb1cec445]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaab3672-694e-41da-b394-8ecbfb2c24e7]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.217s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acdf4da-678a-4039-a1e7-dcff6f81a129]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb, portal: 172.16.0.220,3260]
Nov 14 18:03:06 user nova-compute[76161]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb, portal: 172.16.0.220,3260] successful.
Nov 14 18:03:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ee0408-345f-44ba-abbd-9e3ecaa4e4fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[971c9251-25f5-48db-b8aa-0ba88df8b6b3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.505s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] <== disconnect_volume: return (507ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:03:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:03:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'flavor' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8a88ab67-67bf-4d63-be46-f68aaf8b349b tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.131s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-10a6952b-581a-4bee-9864-f48b6db47c1d req-40c30637-b80f-48fe-b034-8ec38fefea4c service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-10a6952b-581a-4bee-9864-f48b6db47c1d req-40c30637-b80f-48fe-b034-8ec38fefea4c service nova] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-10a6952b-581a-4bee-9864-f48b6db47c1d req-40c30637-b80f-48fe-b034-8ec38fefea4c service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-10a6952b-581a-4bee-9864-f48b6db47c1d req-40c30637-b80f-48fe-b034-8ec38fefea4c service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:07 user nova-compute[76161]: DEBUG nova.compute.manager [req-10a6952b-581a-4bee-9864-f48b6db47c1d req-40c30637-b80f-48fe-b034-8ec38fefea4c service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] No waiting events found dispatching network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:07 user nova-compute[76161]: WARNING nova.compute.manager [req-10a6952b-581a-4bee-9864-f48b6db47c1d req-40c30637-b80f-48fe-b034-8ec38fefea4c service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received unexpected event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 18:03:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:03:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:03:08 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Instance spawned successfully.
Nov 14 18:03:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:03:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a452bd25-e33d-4e4a-b956-e8aa1ac59a54 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.140s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:03:13 user nova-compute[76161]: INFO nova.compute.claims [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Claim successful on node user
Nov 14 18:03:13 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 75295499-8f99-4c9b-a556-c1287c61d8f2 is timed out.
Nov 14 18:03:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully detached device vdb from instance 75295499-8f99-4c9b-a556-c1287c61d8f2 from the live domain config.
Nov 14 18:03:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQzrRHBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:03:13 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f012636e-d81d-4ed3-aed6-94afac9c745d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:03:13 user nova-compute[76161]: No targets found.
Nov 14 18:03:13 user nova-compute[76161]: iSNS:
Nov 14 18:03:13 user nova-compute[76161]: No targets found.
Nov 14 18:03:13 user nova-compute[76161]: STATIC:
Nov 14 18:03:13 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8
Nov 14 18:03:13 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:13 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:13 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:03:13 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:13 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:13 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:03:13 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:13 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:13 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 18:03:13 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:13 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:13 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:03:13 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:13 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:13 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065
Nov 14 18:03:13 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:13 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:13 user nova-compute[76161]: FIRMWARE:
Nov 14 18:03:13 user nova-compute[76161]: No targets found.
Nov 14 18:03:13 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:03:13 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:03:13 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1adcf6a-8831-487b-b4de-aa7197acc871]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[882281c3-1e10-46f2-8316-7badc01f6138]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:13 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:13 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:03:13 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:03:13 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:13 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:13 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:13 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:13 user nova-compute[76161]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 (non-flash)
Nov 14 18:03:13 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:03:13 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:13 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:13 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d06148b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebd5cd2-2e8f-4bc6-89ac-12a9048e8454]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f513b7f5-702a-44e1-9004-2dbb8f050be6]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[95994f0b-e099-4fc3-a0e3-f96273124636]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.081s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fb244e-08ff-44e8-af81-4a0434a42a43]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:03:13 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6932fc28-d3b4-4c74-ab6f-dcc0df382b88]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG nova.network.neutron [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:03:14 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:03:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[47219554-ebf7-4309-b411-6b448e97eb3d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260]
Nov 14 18:03:14 user nova-compute[76161]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8, portal: 172.16.0.220,3260] successful.
Nov 14 18:03:14 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG nova.policy [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd22a86988e6043d2ab950e0d6e557ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81682e21827c4572b1659004cc22215a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0aadcea-0bc4-46b4-b4a5-77abc43079a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[552068b9-53ff-48b1-bbf1-e902314c8ef3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== disconnect_volume: return (398ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:03:14 user nova-compute[76161]: INFO nova.virt.block_device [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Booting with volume snapshot 9dd3c6c6-0aaa-4929-a18e-9fc735cacf31 at /dev/vda
Nov 14 18:03:14 user nova-compute[76161]: DEBUG nova.network.neutron [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Successfully created port: 419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:03:14 user nova-compute[76161]: DEBUG nova.objects.instance [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9df362bf-65b2-48f4-88d0-7acc18ab3210 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.040s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.network.neutron [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Successfully updated port: 419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "refresh_cache-fb619ab6-2509-45d4-8e1e-de40c8d0a07f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquired lock "refresh_cache-fb619ab6-2509-45d4-8e1e-de40c8d0a07f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.network.neutron [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-bce9596d-b1b5-42a0-97e2-f5d651317dfd req-e358a56f-004f-4560-8fc6-56e58d4447f8 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Received event network-changed-419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-bce9596d-b1b5-42a0-97e2-f5d651317dfd req-e358a56f-004f-4560-8fc6-56e58d4447f8 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Refreshing instance network info cache due to event network-changed-419e2daa-e52d-466a-aac8-097f313a3adc. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bce9596d-b1b5-42a0-97e2-f5d651317dfd req-e358a56f-004f-4560-8fc6-56e58d4447f8 service nova] Acquiring lock "refresh_cache-fb619ab6-2509-45d4-8e1e-de40c8d0a07f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.network.neutron [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-54c74500-b22e-48b3-9eae-a3c98d92587f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-54c74500-b22e-48b3-9eae-a3c98d92587f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-54c74500-b22e-48b3-9eae-a3c98d92587f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-54c74500-b22e-48b3-9eae-a3c98d92587f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76161) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.objects.instance [None req-54c74500-b22e-48b3-9eae-a3c98d92587f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.network.neutron [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Updating instance_info_cache with network_info: [{"id": "419e2daa-e52d-466a-aac8-097f313a3adc", "address": "fa:16:3e:c5:6e:b8", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e2daa-e5", "ovs_interfaceid": "419e2daa-e52d-466a-aac8-097f313a3adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Releasing lock "refresh_cache-fb619ab6-2509-45d4-8e1e-de40c8d0a07f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Instance network_info: |[{"id": "419e2daa-e52d-466a-aac8-097f313a3adc", "address": "fa:16:3e:c5:6e:b8", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e2daa-e5", "ovs_interfaceid": "419e2daa-e52d-466a-aac8-097f313a3adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bce9596d-b1b5-42a0-97e2-f5d651317dfd req-e358a56f-004f-4560-8fc6-56e58d4447f8 service nova] Acquired lock "refresh_cache-fb619ab6-2509-45d4-8e1e-de40c8d0a07f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-bce9596d-b1b5-42a0-97e2-f5d651317dfd req-e358a56f-004f-4560-8fc6-56e58d4447f8 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Refreshing network info cache for port 419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG nova.compute.manager [req-3857ec4b-9e37-43da-af54-96f63ac50aaf req-aa826048-b0b8-447a-87a9-438cb3c81572 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3857ec4b-9e37-43da-af54-96f63ac50aaf req-aa826048-b0b8-447a-87a9-438cb3c81572 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3857ec4b-9e37-43da-af54-96f63ac50aaf req-aa826048-b0b8-447a-87a9-438cb3c81572 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3857ec4b-9e37-43da-af54-96f63ac50aaf req-aa826048-b0b8-447a-87a9-438cb3c81572 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG nova.compute.manager [req-3857ec4b-9e37-43da-af54-96f63ac50aaf req-aa826048-b0b8-447a-87a9-438cb3c81572 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:16 user nova-compute[76161]: WARNING nova.compute.manager [req-3857ec4b-9e37-43da-af54-96f63ac50aaf req-aa826048-b0b8-447a-87a9-438cb3c81572 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state active and task_state powering-off.
Nov 14 18:03:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-bce9596d-b1b5-42a0-97e2-f5d651317dfd req-e358a56f-004f-4560-8fc6-56e58d4447f8 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Updated VIF entry in instance network info cache for port 419e2daa-e52d-466a-aac8-097f313a3adc. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-bce9596d-b1b5-42a0-97e2-f5d651317dfd req-e358a56f-004f-4560-8fc6-56e58d4447f8 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Updating instance_info_cache with network_info: [{"id": "419e2daa-e52d-466a-aac8-097f313a3adc", "address": "fa:16:3e:c5:6e:b8", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e2daa-e5", "ovs_interfaceid": "419e2daa-e52d-466a-aac8-097f313a3adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bce9596d-b1b5-42a0-97e2-f5d651317dfd req-e358a56f-004f-4560-8fc6-56e58d4447f8 service nova] Releasing lock "refresh_cache-fb619ab6-2509-45d4-8e1e-de40c8d0a07f" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance destroyed successfully.
Nov 14 18:03:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-54c74500-b22e-48b3-9eae-a3c98d92587f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-54c74500-b22e-48b3-9eae-a3c98d92587f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.848s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:18 user nova-compute[76161]: WARNING nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state stopped and task_state None.
Nov 14 18:03:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:18 user nova-compute[76161]: WARNING nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state stopped and task_state None.
Nov 14 18:03:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:18 user nova-compute[76161]: WARNING nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state stopped and task_state None.
Nov 14 18:03:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:18 user nova-compute[76161]: WARNING nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state stopped and task_state None.
Nov 14 18:03:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:18 user nova-compute[76161]: WARNING nova.compute.manager [req-096f008e-ae5e-40cb-9b24-1ff3ed9c685c req-d059d567-097d-4c26-b9d6-879b20f9a318 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state stopped and task_state None.
Nov 14 18:03:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG os_brick.utils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e018b5-6306-4a16-a5f8-dfe945710fa2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae551b2c-fcf5-46dd-9671-76cfb1343061]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0a14bc-9180-4abb-8960-6cbe135d0598]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4abd0c-8c88-4b40-935b-a121c687a47a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:03:20 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0035fc-021b-46d7-83c0-c2b1d47542b0]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG os_brick.utils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Updating existing volume attachment record: e9c06d91-460c-4b1a-835e-e8c33a251796 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-0d0fc81c-90ed-43e9-b748-8df7cdf5e6ce req-151ea0d4-47fa-45cd-ab24-1df0a44ffb07 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-changed-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-0d0fc81c-90ed-43e9-b748-8df7cdf5e6ce req-151ea0d4-47fa-45cd-ab24-1df0a44ffb07 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Refreshing instance network info cache due to event network-changed-17a4e939-dd34-4c8e-b254-079202ca1814. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0d0fc81c-90ed-43e9-b748-8df7cdf5e6ce req-151ea0d4-47fa-45cd-ab24-1df0a44ffb07 service nova] Acquiring lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0d0fc81c-90ed-43e9-b748-8df7cdf5e6ce req-151ea0d4-47fa-45cd-ab24-1df0a44ffb07 service nova] Acquired lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:03:20 user nova-compute[76161]: DEBUG nova.network.neutron [req-0d0fc81c-90ed-43e9-b748-8df7cdf5e6ce req-151ea0d4-47fa-45cd-ab24-1df0a44ffb07 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Refreshing network info cache for port 17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:21 user nova-compute[76161]: INFO nova.compute.manager [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Terminating instance
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-1e6b80d0-da4b-412c-911d-9e22f98db32e req-b12e5a8b-023e-4073-b865-9edd56dd84c3 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-vif-unplugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1e6b80d0-da4b-412c-911d-9e22f98db32e req-b12e5a8b-023e-4073-b865-9edd56dd84c3 service nova] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1e6b80d0-da4b-412c-911d-9e22f98db32e req-b12e5a8b-023e-4073-b865-9edd56dd84c3 service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1e6b80d0-da4b-412c-911d-9e22f98db32e req-b12e5a8b-023e-4073-b865-9edd56dd84c3 service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-1e6b80d0-da4b-412c-911d-9e22f98db32e req-b12e5a8b-023e-4073-b865-9edd56dd84c3 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] No waiting events found dispatching network-vif-unplugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-1e6b80d0-da4b-412c-911d-9e22f98db32e req-b12e5a8b-023e-4073-b865-9edd56dd84c3 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-vif-unplugged-17a4e939-dd34-4c8e-b254-079202ca1814 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.network.neutron [req-0d0fc81c-90ed-43e9-b748-8df7cdf5e6ce req-151ea0d4-47fa-45cd-ab24-1df0a44ffb07 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updated VIF entry in instance network info cache for port 17a4e939-dd34-4c8e-b254-079202ca1814. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.network.neutron [req-0d0fc81c-90ed-43e9-b748-8df7cdf5e6ce req-151ea0d4-47fa-45cd-ab24-1df0a44ffb07 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating instance_info_cache with network_info: [{"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0d0fc81c-90ed-43e9-b748-8df7cdf5e6ce req-151ea0d4-47fa-45cd-ab24-1df0a44ffb07 service nova] Releasing lock "refresh_cache-c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:03:21 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Instance destroyed successfully.
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lazy-loading 'resources' on Instance uuid c6f53da9-e029-4aa7-8dad-edd41eb2eb5d {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-971044589',display_name='tempest-TestShelveInstance-server-971044589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-971044589',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACZLnDoDR2XNy/4jmfnxkmNhDJA1P9Br59clEYGiQHmDpGAVt5kNhXg5880Zep/dKONHa3tuwi8zStSfZ3O5TInSOxnWMhNTx/hE1EfctdbeJS8CuZ6VujHjO3E2quKbQ==',key_name='tempest-TestShelveInstance-2116969338',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39dc84f83d834a618106830659fee331',ramdisk_id='',reservation_id='r-05v9kppj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1328804028',owner_user_name='tempest-TestShelveInstance-1328804028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:01:46Z,user_data=None,user_id='5b6eb8d881b84217b0e138def245cab0',uuid=c6f53da9-e029-4aa7-8dad-edd41eb2eb5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converting VIF {"id": "17a4e939-dd34-4c8e-b254-079202ca1814", "address": "fa:16:3e:f0:bd:0b", "network": {"id": "786a524d-913a-4555-a067-de07fea74759", "bridge": "br-int", "label": "tempest-TestShelveInstance-1524524807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39dc84f83d834a618106830659fee331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a4e939-dd", "ovs_interfaceid": "17a4e939-dd34-4c8e-b254-079202ca1814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG os_vif [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17a4e939-dd, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd4b4c1a-d9ee-42ae-925f-d39732e9fd3c) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:21 user nova-compute[76161]: INFO os_vif [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=17a4e939-dd34-4c8e-b254-079202ca1814,network=Network(786a524d-913a-4555-a067-de07fea74759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a4e939-dd')
Nov 14 18:03:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrmvRgVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:03:21 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:03:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abdcbc9-de66-496c-ad2d-3c553ac2e489]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:03:21 user nova-compute[76161]: No targets found.
Nov 14 18:03:21 user nova-compute[76161]: iSNS:
Nov 14 18:03:21 user nova-compute[76161]: No targets found.
Nov 14 18:03:21 user nova-compute[76161]: STATIC:
Nov 14 18:03:21 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:03:21 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:21 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:21 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:03:21 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:21 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:21 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a
Nov 14 18:03:21 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:21 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:21 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:03:21 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:21 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:21 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065
Nov 14 18:03:21 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:03:21 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:03:21 user nova-compute[76161]: FIRMWARE:
Nov 14 18:03:21 user nova-compute[76161]: No targets found.
Nov 14 18:03:21 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:03:21 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:03:21 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e9b884-fcc2-41f6-bbcd-e7b9e38c8a64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd54b21-5627-46a7-9933-952b4dfb2299]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:22 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:22 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:03:22 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:22 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:22 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:22 user nova-compute[76161]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a (non-flash)
Nov 14 18:03:22 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:22 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0172200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a'): ({'sdh'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Removing single pathed devices sdh {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[69916d21-25c0-4e16-a5b5-ffbfe3d1854e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updating instance_info_cache with network_info: [{"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d823d04-3a56-4c76-a2bc-18138838576d]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Flushing IO for device /dev/sdh {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-1040ce71-437b-4398-9bb5-bd34e86589a7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c12a14-d1b1-4b85-9677-7b6ada144ac0]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4420acd-3de7-458f-81d4-3e4eb944be2b]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] SCSI volumes sdh have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_87ff1dc6', '/dev/disk/by-id/scsi-1SCST_BIO87ff1dc6-4bf3e9b78b3a13aa', '/dev/disk/by-id/scsi-23462663365396237') {{(pid=86560) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d9a38e-076a-4674-849f-943fc2e662a6]: (4, None) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eee91c-7a99-4d98-b52c-2f8a3fc99609]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4085c067-dc43-4671-a243-b894a6f67e56]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260]
Nov 14 18:03:22 user nova-compute[76161]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a, portal: 172.16.0.220,3260] successful.
Nov 14 18:03:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4f3142-43f5-498f-aeb1-fb864728fb4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad01abf0-0d8a-496d-8428-55c05e235946]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] <== disconnect_volume: return (365ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:03:22 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Deleting instance files /opt/stack/data/nova/instances/c6f53da9-e029-4aa7-8dad-edd41eb2eb5d_del
Nov 14 18:03:22 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Deletion of /opt/stack/data/nova/instances/c6f53da9-e029-4aa7-8dad-edd41eb2eb5d_del complete
Nov 14 18:03:22 user nova-compute[76161]: INFO nova.compute.manager [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 14 18:03:22 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:03:22 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:03:23 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Took 0.81 seconds to deallocate network for instance.
Nov 14 18:03:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-bb0ab32d-3e34-469a-8357-1f953c634122 req-d75c5d2b-4688-4394-aedf-5405d317b6a6 service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-vif-deleted-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-9b721e9f-fee4-4e21-b02a-a0b9f7467978 req-6b89b09d-b4b5-4df6-9ca8-d405349f2a8d service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9b721e9f-fee4-4e21-b02a-a0b9f7467978 req-6b89b09d-b4b5-4df6-9ca8-d405349f2a8d service nova] Acquiring lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9b721e9f-fee4-4e21-b02a-a0b9f7467978 req-6b89b09d-b4b5-4df6-9ca8-d405349f2a8d service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9b721e9f-fee4-4e21-b02a-a0b9f7467978 req-6b89b09d-b4b5-4df6-9ca8-d405349f2a8d service nova] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-9b721e9f-fee4-4e21-b02a-a0b9f7467978 req-6b89b09d-b4b5-4df6-9ca8-d405349f2a8d service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] No waiting events found dispatching network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:23 user nova-compute[76161]: WARNING nova.compute.manager [req-9b721e9f-fee4-4e21-b02a-a0b9f7467978 req-6b89b09d-b4b5-4df6-9ca8-d405349f2a8d service nova] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Received unexpected event network-vif-plugged-17a4e939-dd34-4c8e-b254-079202ca1814 for instance with vm_state active and task_state deleting.
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:24 user nova-compute[76161]: INFO nova.compute.manager [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Took 0.91 seconds to detach 1 volumes for instance.
Nov 14 18:03:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] [instance: c6f53da9-e029-4aa7-8dad-edd41eb2eb5d] Deleting volume: 0e4f3142-43f5-498f-aeb1-fb864728fb4a {{(pid=76161) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 18:03:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.840s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:25 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Deleted allocations for instance c6f53da9-e029-4aa7-8dad-edd41eb2eb5d
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:03:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Creating image(s)
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Ensure instance console log exists: /opt/stack/data/nova/instances/fb619ab6-2509-45d4-8e1e-de40c8d0a07f/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Start _get_guest_xml network_info=[{"id": "419e2daa-e52d-466a-aac8-097f313a3adc", "address": "fa:16:3e:c5:6e:b8", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e2daa-e5", "ovs_interfaceid": "419e2daa-e52d-466a-aac8-097f313a3adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqKwDBUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb619ab6-2509-45d4-8e1e-de40c8d0a07f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c86a846f-30eb-4fd1-a0c2-b631b313815c', 'serial': 'c86a846f-30eb-4fd1-a0c2-b631b313815c'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'e9c06d91-460c-4b1a-835e-e8c33a251796', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a1ad5367-9c76-470d-8c5d-156cc558c647 tempest-TestShelveInstance-1328804028 tempest-TestShelveInstance-1328804028-project-member] Lock "c6f53da9-e029-4aa7-8dad-edd41eb2eb5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.534s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:25 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:03:25 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqKwDBUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:03:25 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:03:25 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:03:25 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d97d23-bfa8-4203-b354-8270defa57a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:03:25 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c40748-9cbe-4be5-8fcb-e2b8d8359237]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c] added
Nov 14 18:03:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9885cc84-4d11-4374-af59-0ea087f46898]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0ab4c4-314e-4bae-9394-95df06213e3c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqKwDBUc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqKwDBUc" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc12d75-7b71-4990-9975-7e869727cb4a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqKwDBUc'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac05570b-09ba-4b32-b571-a5ce30e1280a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbb5b55-d9a3-4d62-bed1-44cf76c1c2fe]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:25 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:25 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:25 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:25 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:25 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:25 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e22f3f7-66aa-4206-a821-d826ca31e603]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c, portal: 172.16.0.220,3260]
Nov 14 18:03:25 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c, portal: 172.16.0.220,3260] successful.
Nov 14 18:03:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b652bf-1b51-4061-b4d6-3cf52ea64d4c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:03:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e5348c-9bcf-4a6d-a52c-0afd0185c637]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:26 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:26 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:26 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:26 user nova-compute[76161]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c (non-flash)
Nov 14 18:03:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:03:26 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:03:26 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:03:26 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:03:26 user nova-compute[76161]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c (non-flash)
Nov 14 18:03:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[818ee954-4e6f-4c78-9062-4317d2da4b06]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqKwDBUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23566363131313733', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566363131313733', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1612669335',display_name='tempest-TestVolumeBootPattern-server-1612669335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1612669335',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-c2ap3qtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:03:14Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=fb619ab6-2509-45d4-8e1e-de40c8d0a07f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419e2daa-e52d-466a-aac8-097f313a3adc", "address": "fa:16:3e:c5:6e:b8", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e2daa-e5", "ovs_interfaceid": "419e2daa-e52d-466a-aac8-097f313a3adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "419e2daa-e52d-466a-aac8-097f313a3adc", "address": "fa:16:3e:c5:6e:b8", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e2daa-e5", "ovs_interfaceid": "419e2daa-e52d-466a-aac8-097f313a3adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=419e2daa-e52d-466a-aac8-097f313a3adc,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e2daa-e5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'pci_devices' on Instance uuid fb619ab6-2509-45d4-8e1e-de40c8d0a07f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:03:27 user nova-compute[76161]:   <uuid>fb619ab6-2509-45d4-8e1e-de40c8d0a07f</uuid>
Nov 14 18:03:27 user nova-compute[76161]:   <name>instance-00000025</name>
Nov 14 18:03:27 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:03:27 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:03:27 user nova-compute[76161]:   <metadata>
Nov 14 18:03:27 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:03:27 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:03:27 user nova-compute[76161]:       <nova:name>tempest-TestVolumeBootPattern-server-1612669335</nova:name>
Nov 14 18:03:27 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:03:25</nova:creationTime>
Nov 14 18:03:27 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:03:27 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:03:27 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:03:27 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:03:27 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:03:27 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:03:27 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:03:27 user nova-compute[76161]:       <nova:owner>
Nov 14 18:03:27 user nova-compute[76161]:         <nova:user uuid="d22a86988e6043d2ab950e0d6e557ef8">tempest-TestVolumeBootPattern-1727647616-project-member</nova:user>
Nov 14 18:03:27 user nova-compute[76161]:         <nova:project uuid="81682e21827c4572b1659004cc22215a">tempest-TestVolumeBootPattern-1727647616</nova:project>
Nov 14 18:03:27 user nova-compute[76161]:       </nova:owner>
Nov 14 18:03:27 user nova-compute[76161]:       <nova:ports>
Nov 14 18:03:27 user nova-compute[76161]:         <nova:port uuid="419e2daa-e52d-466a-aac8-097f313a3adc">
Nov 14 18:03:27 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 18:03:27 user nova-compute[76161]:         </nova:port>
Nov 14 18:03:27 user nova-compute[76161]:       </nova:ports>
Nov 14 18:03:27 user nova-compute[76161]:     </nova:instance>
Nov 14 18:03:27 user nova-compute[76161]:   </metadata>
Nov 14 18:03:27 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:03:27 user nova-compute[76161]:     <system>
Nov 14 18:03:27 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:03:27 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:03:27 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:03:27 user nova-compute[76161]:       <entry name="serial">fb619ab6-2509-45d4-8e1e-de40c8d0a07f</entry>
Nov 14 18:03:27 user nova-compute[76161]:       <entry name="uuid">fb619ab6-2509-45d4-8e1e-de40c8d0a07f</entry>
Nov 14 18:03:27 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:03:27 user nova-compute[76161]:     </system>
Nov 14 18:03:27 user nova-compute[76161]:   </sysinfo>
Nov 14 18:03:27 user nova-compute[76161]:   <os>
Nov 14 18:03:27 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:03:27 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:03:27 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:03:27 user nova-compute[76161]:   </os>
Nov 14 18:03:27 user nova-compute[76161]:   <features>
Nov 14 18:03:27 user nova-compute[76161]:     <acpi/>
Nov 14 18:03:27 user nova-compute[76161]:     <apic/>
Nov 14 18:03:27 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:03:27 user nova-compute[76161]:   </features>
Nov 14 18:03:27 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:03:27 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:03:27 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:03:27 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:03:27 user nova-compute[76161]:   </clock>
Nov 14 18:03:27 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:03:27 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:03:27 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:03:27 user nova-compute[76161]:   </cpu>
Nov 14 18:03:27 user nova-compute[76161]:   <devices>
Nov 14 18:03:27 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:03:27 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:03:27 user nova-compute[76161]:       <source dev="/dev/sdb"/>
Nov 14 18:03:27 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:03:27 user nova-compute[76161]:       <serial>c86a846f-30eb-4fd1-a0c2-b631b313815c</serial>
Nov 14 18:03:27 user nova-compute[76161]:     </disk>
Nov 14 18:03:27 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:03:27 user nova-compute[76161]:       <mac address="fa:16:3e:c5:6e:b8"/>
Nov 14 18:03:27 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:03:27 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:03:27 user nova-compute[76161]:       <target dev="tap419e2daa-e5"/>
Nov 14 18:03:27 user nova-compute[76161]:     </interface>
Nov 14 18:03:27 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:03:27 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/fb619ab6-2509-45d4-8e1e-de40c8d0a07f/console.log" append="off"/>
Nov 14 18:03:27 user nova-compute[76161]:     </serial>
Nov 14 18:03:27 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:03:27 user nova-compute[76161]:     <video>
Nov 14 18:03:27 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:03:27 user nova-compute[76161]:     </video>
Nov 14 18:03:27 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:03:27 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:03:27 user nova-compute[76161]:     </rng>
Nov 14 18:03:27 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:03:27 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:03:27 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:03:27 user nova-compute[76161]:     </memballoon>
Nov 14 18:03:27 user nova-compute[76161]:   </devices>
Nov 14 18:03:27 user nova-compute[76161]: </domain>
Nov 14 18:03:27 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1612669335',display_name='tempest-TestVolumeBootPattern-server-1612669335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1612669335',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-c2ap3qtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:03:14Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=fb619ab6-2509-45d4-8e1e-de40c8d0a07f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419e2daa-e52d-466a-aac8-097f313a3adc", "address": "fa:16:3e:c5:6e:b8", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e2daa-e5", "ovs_interfaceid": "419e2daa-e52d-466a-aac8-097f313a3adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "419e2daa-e52d-466a-aac8-097f313a3adc", "address": "fa:16:3e:c5:6e:b8", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e2daa-e5", "ovs_interfaceid": "419e2daa-e52d-466a-aac8-097f313a3adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=419e2daa-e52d-466a-aac8-097f313a3adc,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e2daa-e5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG os_vif [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=419e2daa-e52d-466a-aac8-097f313a3adc,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e2daa-e5') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ba6aca2-2ecf-5152-9a35-10e26940b7e8', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap419e2daa-e5, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap419e2daa-e5, col_values=(('qos', UUID('1655e8a2-9132-4e2b-b43b-9c8281c893ed')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap419e2daa-e5, col_values=(('external_ids', {'iface-id': '419e2daa-e52d-466a-aac8-097f313a3adc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:6e:b8', 'vm-uuid': 'fb619ab6-2509-45d4-8e1e-de40c8d0a07f'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:27 user nova-compute[76161]: INFO os_vif [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=419e2daa-e52d-466a-aac8-097f313a3adc,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e2daa-e5')
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No VIF found with MAC fa:16:3e:c5:6e:b8, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:03:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7478MB free_disk=24.98159408569336GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Applying migration context for instance a0a5d3ce-4564-434d-9650-36548fb33ab0 as it has an incoming, in-progress migration ca93d3c3-1e69-48f3-a14b-9d83f946cd0e. Migration status is finished {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 18:03:28 user nova-compute[76161]: INFO nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating resource usage from migration ca93d3c3-1e69-48f3-a14b-9d83f946cd0e
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 75295499-8f99-4c9b-a556-c1287c61d8f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 8a5c3b81-d4e1-416f-9512-592fe67cae44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 385ef873-fc1f-46ae-90da-b75f82524b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance cd162511-a09b-4479-8d29-0a5a4b40ae78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Migration ca93d3c3-1e69-48f3-a14b-9d83f946cd0e is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0a5d3ce-4564-434d-9650-36548fb33ab0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance fb619ab6-2509-45d4-8e1e-de40c8d0a07f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-153fc4de-1b8e-4d94-b552-96dfda32daf5 req-8ad91b96-4e1a-48d3-b880-70c82ad1cde8 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Received event network-vif-plugged-419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-153fc4de-1b8e-4d94-b552-96dfda32daf5 req-8ad91b96-4e1a-48d3-b880-70c82ad1cde8 service nova] Acquiring lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-153fc4de-1b8e-4d94-b552-96dfda32daf5 req-8ad91b96-4e1a-48d3-b880-70c82ad1cde8 service nova] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-153fc4de-1b8e-4d94-b552-96dfda32daf5 req-8ad91b96-4e1a-48d3-b880-70c82ad1cde8 service nova] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-153fc4de-1b8e-4d94-b552-96dfda32daf5 req-8ad91b96-4e1a-48d3-b880-70c82ad1cde8 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] No waiting events found dispatching network-vif-plugged-419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:28 user nova-compute[76161]: WARNING nova.compute.manager [req-153fc4de-1b8e-4d94-b552-96dfda32daf5 req-8ad91b96-4e1a-48d3-b880-70c82ad1cde8 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Received unexpected event network-vif-plugged-419e2daa-e52d-466a-aac8-097f313a3adc for instance with vm_state building and task_state spawning.
Nov 14 18:03:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:03:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.726s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:03:30 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Instance spawned successfully.
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-8e71392b-46aa-4bba-8fec-a048c103372f req-e15bd101-60ad-460b-a7eb-f7e4a0bf9908 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Received event network-vif-plugged-419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8e71392b-46aa-4bba-8fec-a048c103372f req-e15bd101-60ad-460b-a7eb-f7e4a0bf9908 service nova] Acquiring lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8e71392b-46aa-4bba-8fec-a048c103372f req-e15bd101-60ad-460b-a7eb-f7e4a0bf9908 service nova] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8e71392b-46aa-4bba-8fec-a048c103372f req-e15bd101-60ad-460b-a7eb-f7e4a0bf9908 service nova] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-8e71392b-46aa-4bba-8fec-a048c103372f req-e15bd101-60ad-460b-a7eb-f7e4a0bf9908 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] No waiting events found dispatching network-vif-plugged-419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:30 user nova-compute[76161]: WARNING nova.compute.manager [req-8e71392b-46aa-4bba-8fec-a048c103372f req-e15bd101-60ad-460b-a7eb-f7e4a0bf9908 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Received unexpected event network-vif-plugged-419e2daa-e52d-466a-aac8-097f313a3adc for instance with vm_state building and task_state spawning.
Nov 14 18:03:31 user nova-compute[76161]: INFO nova.compute.manager [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 14 18:03:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:03:31 user nova-compute[76161]: INFO nova.compute.manager [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Took 17.79 seconds to build instance.
Nov 14 18:03:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7c470245-bff3-4790-8590-15efe591d9d8 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.894s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:41 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:03:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:03:41 user nova-compute[76161]: INFO nova.compute.claims [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Claim successful on node user
Nov 14 18:03:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.994s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:03:42 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:03:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG nova.policy [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49edd5581ca44780ac590c2b072b338d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45eab8e344af47a2b1b28fa471a4acc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:03:42 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Creating image(s)
Nov 14 18:03:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "/opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "/opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "/opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.168s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk 1073741824" returned: 0 in 0.052s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Successfully created port: 9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.230s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Cannot resize image /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Ensure instance console log exists: /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Successfully updated port: 9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "refresh_cache-236486e6-e33d-4027-a91e-dd2c6cb20ce7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquired lock "refresh_cache-236486e6-e33d-4027-a91e-dd2c6cb20ce7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.compute.manager [req-364642a6-f5b7-4bcc-b84f-f1796296355d req-809ea87d-91e2-4266-b8aa-9ddb885ef318 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received event network-changed-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.compute.manager [req-364642a6-f5b7-4bcc-b84f-f1796296355d req-809ea87d-91e2-4266-b8aa-9ddb885ef318 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Refreshing instance network info cache due to event network-changed-9c1e8d73-f859-469b-9e3d-3be83cbbe22c. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-364642a6-f5b7-4bcc-b84f-f1796296355d req-809ea87d-91e2-4266-b8aa-9ddb885ef318 service nova] Acquiring lock "refresh_cache-236486e6-e33d-4027-a91e-dd2c6cb20ce7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Updating instance_info_cache with network_info: [{"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Releasing lock "refresh_cache-236486e6-e33d-4027-a91e-dd2c6cb20ce7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Instance network_info: |[{"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-364642a6-f5b7-4bcc-b84f-f1796296355d req-809ea87d-91e2-4266-b8aa-9ddb885ef318 service nova] Acquired lock "refresh_cache-236486e6-e33d-4027-a91e-dd2c6cb20ce7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.network.neutron [req-364642a6-f5b7-4bcc-b84f-f1796296355d req-809ea87d-91e2-4266-b8aa-9ddb885ef318 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Refreshing network info cache for port 9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Start _get_guest_xml network_info=[{"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:03:44 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:03:44 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-972451438',display_name='tempest-AttachVolumeNegativeTest-server-972451438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-972451438',id=38,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqn45symUWCucAAgdZuPkUZb4h1A0qpALvO2TV/mFJs5/2aKNDquNCnM85pbMPX/BmqaAKX3+ZUUuHANJ21TQ3ICT0rnkCI4yXmyO704M4vZupDa9SO+eQI6vtPj4fRUg==',key_name='tempest-keypair-430670252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-u6yxya07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=236486e6-e33d-4027-a91e-dd2c6cb20ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0f:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c1e8d73-f859-469b-9e3d-3be83cbbe22c,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1e8d73-f8') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'pci_devices' on Instance uuid 236486e6-e33d-4027-a91e-dd2c6cb20ce7 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:03:44 user nova-compute[76161]:   <uuid>236486e6-e33d-4027-a91e-dd2c6cb20ce7</uuid>
Nov 14 18:03:44 user nova-compute[76161]:   <name>instance-00000026</name>
Nov 14 18:03:44 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:03:44 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:03:44 user nova-compute[76161]:   <metadata>
Nov 14 18:03:44 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:03:44 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:03:44 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeNegativeTest-server-972451438</nova:name>
Nov 14 18:03:44 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:03:44</nova:creationTime>
Nov 14 18:03:44 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:03:44 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:03:44 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:03:44 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:03:44 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:03:44 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:03:44 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:03:44 user nova-compute[76161]:       <nova:owner>
Nov 14 18:03:44 user nova-compute[76161]:         <nova:user uuid="49edd5581ca44780ac590c2b072b338d">tempest-AttachVolumeNegativeTest-453609882-project-member</nova:user>
Nov 14 18:03:44 user nova-compute[76161]:         <nova:project uuid="45eab8e344af47a2b1b28fa471a4acc3">tempest-AttachVolumeNegativeTest-453609882</nova:project>
Nov 14 18:03:44 user nova-compute[76161]:       </nova:owner>
Nov 14 18:03:44 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:03:44 user nova-compute[76161]:       <nova:ports>
Nov 14 18:03:44 user nova-compute[76161]:         <nova:port uuid="9c1e8d73-f859-469b-9e3d-3be83cbbe22c">
Nov 14 18:03:44 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 18:03:44 user nova-compute[76161]:         </nova:port>
Nov 14 18:03:44 user nova-compute[76161]:       </nova:ports>
Nov 14 18:03:44 user nova-compute[76161]:     </nova:instance>
Nov 14 18:03:44 user nova-compute[76161]:   </metadata>
Nov 14 18:03:44 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:03:44 user nova-compute[76161]:     <system>
Nov 14 18:03:44 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:03:44 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:03:44 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:03:44 user nova-compute[76161]:       <entry name="serial">236486e6-e33d-4027-a91e-dd2c6cb20ce7</entry>
Nov 14 18:03:44 user nova-compute[76161]:       <entry name="uuid">236486e6-e33d-4027-a91e-dd2c6cb20ce7</entry>
Nov 14 18:03:44 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:03:44 user nova-compute[76161]:     </system>
Nov 14 18:03:44 user nova-compute[76161]:   </sysinfo>
Nov 14 18:03:44 user nova-compute[76161]:   <os>
Nov 14 18:03:44 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:03:44 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:03:44 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:03:44 user nova-compute[76161]:   </os>
Nov 14 18:03:44 user nova-compute[76161]:   <features>
Nov 14 18:03:44 user nova-compute[76161]:     <acpi/>
Nov 14 18:03:44 user nova-compute[76161]:     <apic/>
Nov 14 18:03:44 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:03:44 user nova-compute[76161]:   </features>
Nov 14 18:03:44 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:03:44 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:03:44 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:03:44 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:03:44 user nova-compute[76161]:   </clock>
Nov 14 18:03:44 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:03:44 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:03:44 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:03:44 user nova-compute[76161]:   </cpu>
Nov 14 18:03:44 user nova-compute[76161]:   <devices>
Nov 14 18:03:44 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:03:44 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:03:44 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk"/>
Nov 14 18:03:44 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:03:44 user nova-compute[76161]:     </disk>
Nov 14 18:03:44 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:03:44 user nova-compute[76161]:       <mac address="fa:16:3e:e2:0f:f4"/>
Nov 14 18:03:44 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:03:44 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:03:44 user nova-compute[76161]:       <target dev="tap9c1e8d73-f8"/>
Nov 14 18:03:44 user nova-compute[76161]:     </interface>
Nov 14 18:03:44 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:03:44 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/console.log" append="off"/>
Nov 14 18:03:44 user nova-compute[76161]:     </serial>
Nov 14 18:03:44 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:03:44 user nova-compute[76161]:     <video>
Nov 14 18:03:44 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:03:44 user nova-compute[76161]:     </video>
Nov 14 18:03:44 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:03:44 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:03:44 user nova-compute[76161]:     </rng>
Nov 14 18:03:44 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:03:44 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:03:44 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:03:44 user nova-compute[76161]:     </memballoon>
Nov 14 18:03:44 user nova-compute[76161]:   </devices>
Nov 14 18:03:44 user nova-compute[76161]: </domain>
Nov 14 18:03:44 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-972451438',display_name='tempest-AttachVolumeNegativeTest-server-972451438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-972451438',id=38,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqn45symUWCucAAgdZuPkUZb4h1A0qpALvO2TV/mFJs5/2aKNDquNCnM85pbMPX/BmqaAKX3+ZUUuHANJ21TQ3ICT0rnkCI4yXmyO704M4vZupDa9SO+eQI6vtPj4fRUg==',key_name='tempest-keypair-430670252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-u6yxya07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=236486e6-e33d-4027-a91e-dd2c6cb20ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0f:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c1e8d73-f859-469b-9e3d-3be83cbbe22c,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1e8d73-f8') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG os_vif [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0f:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c1e8d73-f859-469b-9e3d-3be83cbbe22c,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1e8d73-f8') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90970aa3-efbb-514e-b39b-59b77fa6cd8d', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c1e8d73-f8, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c1e8d73-f8, col_values=(('qos', UUID('145d2827-6078-4a23-8668-f910d9d35bbd')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c1e8d73-f8, col_values=(('external_ids', {'iface-id': '9c1e8d73-f859-469b-9e3d-3be83cbbe22c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:0f:f4', 'vm-uuid': '236486e6-e33d-4027-a91e-dd2c6cb20ce7'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:03:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:44 user nova-compute[76161]: INFO os_vif [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0f:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c1e8d73-f859-469b-9e3d-3be83cbbe22c,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1e8d73-f8')
Nov 14 18:03:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:03:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No VIF found with MAC fa:16:3e:e2:0f:f4, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:03:45 user nova-compute[76161]: DEBUG nova.network.neutron [req-364642a6-f5b7-4bcc-b84f-f1796296355d req-809ea87d-91e2-4266-b8aa-9ddb885ef318 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Updated VIF entry in instance network info cache for port 9c1e8d73-f859-469b-9e3d-3be83cbbe22c. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:03:45 user nova-compute[76161]: DEBUG nova.network.neutron [req-364642a6-f5b7-4bcc-b84f-f1796296355d req-809ea87d-91e2-4266-b8aa-9ddb885ef318 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Updating instance_info_cache with network_info: [{"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:03:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-364642a6-f5b7-4bcc-b84f-f1796296355d req-809ea87d-91e2-4266-b8aa-9ddb885ef318 service nova] Releasing lock "refresh_cache-236486e6-e33d-4027-a91e-dd2c6cb20ce7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:03:45 user nova-compute[76161]: INFO nova.compute.manager [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Rescuing
Nov 14 18:03:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:03:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquired lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:03:45 user nova-compute[76161]: DEBUG nova.network.neutron [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG nova.network.neutron [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updating instance_info_cache with network_info: [{"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Releasing lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG nova.compute.manager [req-1c008097-9d32-4f16-b60d-905aa2eafaad req-026fb1ac-2274-44a7-8bb6-68d50c706beb service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-unplugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1c008097-9d32-4f16-b60d-905aa2eafaad req-026fb1ac-2274-44a7-8bb6-68d50c706beb service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1c008097-9d32-4f16-b60d-905aa2eafaad req-026fb1ac-2274-44a7-8bb6-68d50c706beb service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1c008097-9d32-4f16-b60d-905aa2eafaad req-026fb1ac-2274-44a7-8bb6-68d50c706beb service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG nova.compute.manager [req-1c008097-9d32-4f16-b60d-905aa2eafaad req-026fb1ac-2274-44a7-8bb6-68d50c706beb service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-unplugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:46 user nova-compute[76161]: WARNING nova.compute.manager [req-1c008097-9d32-4f16-b60d-905aa2eafaad req-026fb1ac-2274-44a7-8bb6-68d50c706beb service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-unplugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state active and task_state rescuing.
Nov 14 18:03:46 user nova-compute[76161]: DEBUG nova.compute.manager [req-e63f0f90-80ae-40eb-adc3-57c72de5865f req-ba298ebc-0753-4253-bbe4-aafac2407e10 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received event network-vif-plugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e63f0f90-80ae-40eb-adc3-57c72de5865f req-ba298ebc-0753-4253-bbe4-aafac2407e10 service nova] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e63f0f90-80ae-40eb-adc3-57c72de5865f req-ba298ebc-0753-4253-bbe4-aafac2407e10 service nova] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e63f0f90-80ae-40eb-adc3-57c72de5865f req-ba298ebc-0753-4253-bbe4-aafac2407e10 service nova] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG nova.compute.manager [req-e63f0f90-80ae-40eb-adc3-57c72de5865f req-ba298ebc-0753-4253-bbe4-aafac2407e10 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] No waiting events found dispatching network-vif-plugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:46 user nova-compute[76161]: WARNING nova.compute.manager [req-e63f0f90-80ae-40eb-adc3-57c72de5865f req-ba298ebc-0753-4253-bbe4-aafac2407e10 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received unexpected event network-vif-plugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c for instance with vm_state building and task_state spawning.
Nov 14 18:03:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:47 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Instance destroyed successfully.
Nov 14 18:03:47 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Attempting rescue
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76161) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Instance directory exists: not creating {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 18:03:47 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Creating image(s)
Nov 14 18:03:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'trusted_certs' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.212s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue" returned: 0 in 0.055s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'migration_context' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.base [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<b223bed6-d3c6-4841-94e3-73adfb708b8a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Start _get_guest_xml network_info=[{"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "vif_mac": "fa:16:3e:0c:18:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'resources' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.base [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<b223bed6-d3c6-4841-94e3-73adfb708b8a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'numa_topology' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.base [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<b223bed6-d3c6-4841-94e3-73adfb708b8a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:03:47 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:03:47 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'vcpu_model' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.base [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<b223bed6-d3c6-4841-94e3-73adfb708b8a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-482828575',display_name='tempest-ServerRescueNegativeTestJSON-server-482828575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-482828575',id=30,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:59:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-2w3w7gtf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:59:12Z,user_data=None,user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=b223bed6-d3c6-4841-94e3-73adfb708b8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "vif_mac": "fa:16:3e:0c:18:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "vif_mac": "fa:16:3e:0c:18:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:db,bridge_name='br-int',has_traffic_filtering=True,id=b4744605-ae45-4625-bdc2-e25dedc542e4,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744605-ae') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'pci_devices' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.objects.base [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<b223bed6-d3c6-4841-94e3-73adfb708b8a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:03:47 user nova-compute[76161]:   <uuid>b223bed6-d3c6-4841-94e3-73adfb708b8a</uuid>
Nov 14 18:03:47 user nova-compute[76161]:   <name>instance-0000001e</name>
Nov 14 18:03:47 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:03:47 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:03:47 user nova-compute[76161]:   <metadata>
Nov 14 18:03:47 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:03:47 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:03:47 user nova-compute[76161]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-482828575</nova:name>
Nov 14 18:03:47 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:03:47</nova:creationTime>
Nov 14 18:03:47 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:03:47 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:03:47 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:03:47 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:03:47 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:03:47 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:03:47 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:03:47 user nova-compute[76161]:       <nova:owner>
Nov 14 18:03:47 user nova-compute[76161]:         <nova:user uuid="d463f3fddeba4976bded6ba5abc6c98c">tempest-ServerRescueNegativeTestJSON-1787067728-project-member</nova:user>
Nov 14 18:03:47 user nova-compute[76161]:         <nova:project uuid="952a823fe4e04963916979f78d5c82a7">tempest-ServerRescueNegativeTestJSON-1787067728</nova:project>
Nov 14 18:03:47 user nova-compute[76161]:       </nova:owner>
Nov 14 18:03:47 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:03:47 user nova-compute[76161]:       <nova:ports>
Nov 14 18:03:47 user nova-compute[76161]:         <nova:port uuid="b4744605-ae45-4625-bdc2-e25dedc542e4">
Nov 14 18:03:47 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 18:03:47 user nova-compute[76161]:         </nova:port>
Nov 14 18:03:47 user nova-compute[76161]:       </nova:ports>
Nov 14 18:03:47 user nova-compute[76161]:     </nova:instance>
Nov 14 18:03:47 user nova-compute[76161]:   </metadata>
Nov 14 18:03:47 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:03:47 user nova-compute[76161]:     <system>
Nov 14 18:03:47 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:03:47 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:03:47 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:03:47 user nova-compute[76161]:       <entry name="serial">b223bed6-d3c6-4841-94e3-73adfb708b8a</entry>
Nov 14 18:03:47 user nova-compute[76161]:       <entry name="uuid">b223bed6-d3c6-4841-94e3-73adfb708b8a</entry>
Nov 14 18:03:47 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:03:47 user nova-compute[76161]:     </system>
Nov 14 18:03:47 user nova-compute[76161]:   </sysinfo>
Nov 14 18:03:47 user nova-compute[76161]:   <os>
Nov 14 18:03:47 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:03:47 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:03:47 user nova-compute[76161]:   </os>
Nov 14 18:03:47 user nova-compute[76161]:   <features>
Nov 14 18:03:47 user nova-compute[76161]:     <acpi/>
Nov 14 18:03:47 user nova-compute[76161]:     <apic/>
Nov 14 18:03:47 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:03:47 user nova-compute[76161]:   </features>
Nov 14 18:03:47 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:03:47 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:03:47 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:03:47 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:03:47 user nova-compute[76161]:   </clock>
Nov 14 18:03:47 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:03:47 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:03:47 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:03:47 user nova-compute[76161]:   </cpu>
Nov 14 18:03:47 user nova-compute[76161]:   <devices>
Nov 14 18:03:47 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:03:47 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:03:47 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue"/>
Nov 14 18:03:47 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:03:47 user nova-compute[76161]:     </disk>
Nov 14 18:03:47 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:03:47 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:03:47 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk"/>
Nov 14 18:03:47 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 18:03:47 user nova-compute[76161]:     </disk>
Nov 14 18:03:47 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:03:47 user nova-compute[76161]:       <mac address="fa:16:3e:0c:18:db"/>
Nov 14 18:03:47 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:03:47 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:03:47 user nova-compute[76161]:       <target dev="tapb4744605-ae"/>
Nov 14 18:03:47 user nova-compute[76161]:     </interface>
Nov 14 18:03:47 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:03:47 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/console.log" append="off"/>
Nov 14 18:03:47 user nova-compute[76161]:     </serial>
Nov 14 18:03:47 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:03:47 user nova-compute[76161]:     <video>
Nov 14 18:03:47 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:03:47 user nova-compute[76161]:     </video>
Nov 14 18:03:47 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:03:47 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:03:47 user nova-compute[76161]:     </rng>
Nov 14 18:03:47 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:03:47 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:03:47 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:03:47 user nova-compute[76161]:     </memballoon>
Nov 14 18:03:47 user nova-compute[76161]:   </devices>
Nov 14 18:03:47 user nova-compute[76161]: </domain>
Nov 14 18:03:47 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:03:47 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Instance destroyed successfully.
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:03:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No VIF found with MAC fa:16:3e:0c:18:db, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:03:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-351d060a-bdbd-4089-a204-aefca159f39c req-6ae40b1f-4c95-42b2-88e8-0b605db93156 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-351d060a-bdbd-4089-a204-aefca159f39c req-6ae40b1f-4c95-42b2-88e8-0b605db93156 service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-351d060a-bdbd-4089-a204-aefca159f39c req-6ae40b1f-4c95-42b2-88e8-0b605db93156 service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-351d060a-bdbd-4089-a204-aefca159f39c req-6ae40b1f-4c95-42b2-88e8-0b605db93156 service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-351d060a-bdbd-4089-a204-aefca159f39c req-6ae40b1f-4c95-42b2-88e8-0b605db93156 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:48 user nova-compute[76161]: WARNING nova.compute.manager [req-351d060a-bdbd-4089-a204-aefca159f39c req-6ae40b1f-4c95-42b2-88e8-0b605db93156 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state active and task_state rescuing.
Nov 14 18:03:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-3cddf855-3d1f-48b3-8e43-51a3bf2a341b req-3fa79e96-b335-4f65-922b-71632f7f9326 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received event network-vif-plugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3cddf855-3d1f-48b3-8e43-51a3bf2a341b req-3fa79e96-b335-4f65-922b-71632f7f9326 service nova] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3cddf855-3d1f-48b3-8e43-51a3bf2a341b req-3fa79e96-b335-4f65-922b-71632f7f9326 service nova] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3cddf855-3d1f-48b3-8e43-51a3bf2a341b req-3fa79e96-b335-4f65-922b-71632f7f9326 service nova] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-3cddf855-3d1f-48b3-8e43-51a3bf2a341b req-3fa79e96-b335-4f65-922b-71632f7f9326 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] No waiting events found dispatching network-vif-plugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:48 user nova-compute[76161]: WARNING nova.compute.manager [req-3cddf855-3d1f-48b3-8e43-51a3bf2a341b req-3fa79e96-b335-4f65-922b-71632f7f9326 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received unexpected event network-vif-plugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c for instance with vm_state building and task_state spawning.
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:03:49 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Instance spawned successfully.
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:03:49 user nova-compute[76161]: INFO nova.compute.manager [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: INFO nova.compute.manager [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Took 7.69 seconds to build instance.
Nov 14 18:03:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d8f7d20f-7a47-401b-8bfb-b74192426a10 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.786s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:49 user nova-compute[76161]: INFO nova.compute.manager [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Terminating instance
Nov 14 18:03:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:50 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Instance destroyed successfully.
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.objects.instance [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lazy-loading 'resources' on Instance uuid 8a5c3b81-d4e1-416f-9512-592fe67cae44 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-189553259',display_name='tempest-SnapshotDataIntegrityTests-server-189553259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-189553259',id=25,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDt3lo6Y8Z81wxoX7amNiseedBPKYvwo1v10BHhBgMUDV0Hl64h0dxZPjY9qdMXj+xl098UBo67rxy12yJUJzYOR7oNSRwlKN7vehX8KF5qd4cKBS+67e6abaQcZpZKszg==',key_name='tempest-keypair-852008085',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1687dfa28b6143d5a39d894cb3d943f9',ramdisk_id='',reservation_id='r-17qclt8e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-21028194',owner_user_name='tempest-SnapshotDataIntegrityTests-21028194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='697caec857bd4d6089435bcc9016e3b2',uuid=8a5c3b81-d4e1-416f-9512-592fe67cae44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Converting VIF {"id": "ec00dfa7-65ad-414a-9001-06902e33b728", "address": "fa:16:3e:24:51:b7", "network": {"id": "83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-233218567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1687dfa28b6143d5a39d894cb3d943f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec00dfa7-65", "ovs_interfaceid": "ec00dfa7-65ad-414a-9001-06902e33b728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:51:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec00dfa7-65ad-414a-9001-06902e33b728,network=Network(83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec00dfa7-65') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG os_vif [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:51:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec00dfa7-65ad-414a-9001-06902e33b728,network=Network(83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec00dfa7-65') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec00dfa7-65, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23588056-3de9-4783-8a55-8665206cdd49) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:50 user nova-compute[76161]: INFO os_vif [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:51:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec00dfa7-65ad-414a-9001-06902e33b728,network=Network(83ecdeb3-fd0d-4559-a253-57c1dd2e3f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec00dfa7-65')
Nov 14 18:03:50 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Deleting instance files /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44_del
Nov 14 18:03:50 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Deletion of /opt/stack/data/nova/instances/8a5c3b81-d4e1-416f-9512-592fe67cae44_del complete
Nov 14 18:03:50 user nova-compute[76161]: INFO nova.compute.manager [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:50 user nova-compute[76161]: WARNING nova.compute.manager [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state active and task_state rescuing.
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:50 user nova-compute[76161]: WARNING nova.compute.manager [req-d3fae844-1bbc-44de-9cf2-dd94f5cd5317 req-c3f6e7c8-a6e8-4d9e-ae7b-28143ba852f2 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state active and task_state rescuing.
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received event network-vif-unplugged-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] No waiting events found dispatching network-vif-unplugged-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received event network-vif-unplugged-ec00dfa7-65ad-414a-9001-06902e33b728 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received event network-vif-plugged-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] Acquiring lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] No waiting events found dispatching network-vif-plugged-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:03:50 user nova-compute[76161]: WARNING nova.compute.manager [req-25ccb700-c362-4140-ae29-22405b065588 req-219f50d3-8936-464d-b830-f10175c24801 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received unexpected event network-vif-plugged-ec00dfa7-65ad-414a-9001-06902e33b728 for instance with vm_state active and task_state deleting.
Nov 14 18:03:51 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:03:51 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Took 0.93 seconds to deallocate network for instance.
Nov 14 18:03:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-b7bed812-799a-4102-9b2a-f5052502a016 req-e91fa789-3896-4e52-a4e2-ed522587d4c0 service nova] [instance: 8a5c3b81-d4e1-416f-9512-592fe67cae44] Received event network-vif-deleted-ec00dfa7-65ad-414a-9001-06902e33b728 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:03:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7008a5b4-3b8d-4104-90fd-94e24f04c21a tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:03:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:03:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:03:51 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:03:51 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:03:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:51 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Deleted allocations for instance 8a5c3b81-d4e1-416f-9512-592fe67cae44
Nov 14 18:03:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1846be12-234e-4051-8cc7-182860d4717a tempest-SnapshotDataIntegrityTests-21028194 tempest-SnapshotDataIntegrityTests-21028194-project-member] Lock "8a5c3b81-d4e1-416f-9512-592fe67cae44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:03:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:03:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:04:18 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:04:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:04:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:04:18 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:04:18 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updating instance_info_cache with network_info: [{"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:04:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-e6b27e32-d956-4f41-b278-d7d088c7edbc" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:04:18 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:04:18 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:04:19 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:04:19 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:04:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:21 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:04:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:04:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:04:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:04:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7281MB free_disk=24.975605010986328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Applying migration context for instance a0a5d3ce-4564-434d-9650-36548fb33ab0 as it has an incoming, in-progress migration ca93d3c3-1e69-48f3-a14b-9d83f946cd0e. Migration status is finished {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 18:04:28 user nova-compute[76161]: INFO nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating resource usage from migration ca93d3c3-1e69-48f3-a14b-9d83f946cd0e
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 75295499-8f99-4c9b-a556-c1287c61d8f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 385ef873-fc1f-46ae-90da-b75f82524b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance cd162511-a09b-4479-8d29-0a5a4b40ae78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Migration ca93d3c3-1e69-48f3-a14b-9d83f946cd0e is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0a5d3ce-4564-434d-9650-36548fb33ab0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance fb619ab6-2509-45d4-8e1e-de40c8d0a07f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:04:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:04:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:04:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:04:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:04:29 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:04:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:30 user nova-compute[76161]: INFO nova.compute.manager [None req-d9d276ca-6660-4bfb-98bd-66c272d3e3aa tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Unrescuing
Nov 14 18:04:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d9d276ca-6660-4bfb-98bd-66c272d3e3aa tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:04:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d9d276ca-6660-4bfb-98bd-66c272d3e3aa tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquired lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:04:30 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d9d276ca-6660-4bfb-98bd-66c272d3e3aa tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d9d276ca-6660-4bfb-98bd-66c272d3e3aa tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Updating instance_info_cache with network_info: [{"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d9d276ca-6660-4bfb-98bd-66c272d3e3aa tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Releasing lock "refresh_cache-cd162511-a09b-4479-8d29-0a5a4b40ae78" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d9d276ca-6660-4bfb-98bd-66c272d3e3aa tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'flavor' on Instance uuid cd162511-a09b-4479-8d29-0a5a4b40ae78 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-d3dd9733-db80-4c37-bcaf-66f360e3a766 req-71c5876c-cdc3-44ec-9c89-87d3b1bffd27 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-unplugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d3dd9733-db80-4c37-bcaf-66f360e3a766 req-71c5876c-cdc3-44ec-9c89-87d3b1bffd27 service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d3dd9733-db80-4c37-bcaf-66f360e3a766 req-71c5876c-cdc3-44ec-9c89-87d3b1bffd27 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d3dd9733-db80-4c37-bcaf-66f360e3a766 req-71c5876c-cdc3-44ec-9c89-87d3b1bffd27 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-d3dd9733-db80-4c37-bcaf-66f360e3a766 req-71c5876c-cdc3-44ec-9c89-87d3b1bffd27 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-unplugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:04:31 user nova-compute[76161]: WARNING nova.compute.manager [req-d3dd9733-db80-4c37-bcaf-66f360e3a766 req-71c5876c-cdc3-44ec-9c89-87d3b1bffd27 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-unplugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:04:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:04:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Going to confirm migration 2 {{(pid=76161) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 18:04:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Instance destroyed successfully.
Nov 14 18:04:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:04:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquired lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:04:32 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:04:32 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'info_cache' on Instance uuid a0a5d3ce-4564-434d-9650-36548fb33ab0 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:04:32 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating instance_info_cache with network_info: [{"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:04:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Releasing lock "refresh_cache-a0a5d3ce-4564-434d-9650-36548fb33ab0" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:04:32 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'migration_context' on Instance uuid a0a5d3ce-4564-434d-9650-36548fb33ab0 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:04:32 user nova-compute[76161]: DEBUG nova.objects.base [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Object Instance<a0a5d3ce-4564-434d-9650-36548fb33ab0> lazy-loaded attributes: info_cache,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:04:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:04:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.433s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:04:33 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Deleted allocation for migration ca93d3c3-1e69-48f3-a14b-9d83f946cd0e
Nov 14 18:04:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6c34d965-fa6e-4a1f-99b6-19a1472b2cc8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.382s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:04:33 user nova-compute[76161]: WARNING nova.compute.manager [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:04:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:04:33 user nova-compute[76161]: WARNING nova.compute.manager [req-d0b9488a-333c-4d2e-a102-62ee52d56ab4 req-2a89e1bf-070f-47a7-a5da-bc594c36b95c service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:04:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:35 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d9d276ca-6660-4bfb-98bd-66c272d3e3aa tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:04:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-61205e51-6a03-482c-8832-dc1c8414fb74 req-5773172d-9dc6-4b7f-979a-786970397784 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:04:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-61205e51-6a03-482c-8832-dc1c8414fb74 req-5773172d-9dc6-4b7f-979a-786970397784 service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:04:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-61205e51-6a03-482c-8832-dc1c8414fb74 req-5773172d-9dc6-4b7f-979a-786970397784 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:04:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-61205e51-6a03-482c-8832-dc1c8414fb74 req-5773172d-9dc6-4b7f-979a-786970397784 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:04:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-61205e51-6a03-482c-8832-dc1c8414fb74 req-5773172d-9dc6-4b7f-979a-786970397784 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:04:35 user nova-compute[76161]: WARNING nova.compute.manager [req-61205e51-6a03-482c-8832-dc1c8414fb74 req-5773172d-9dc6-4b7f-979a-786970397784 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state active and task_state None.
Nov 14 18:04:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:04:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:04:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:40 user nova-compute[76161]: INFO nova.compute.manager [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Detaching volume bf6ef675-607c-45f6-866c-f74f687b5065
Nov 14 18:04:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:40 user nova-compute[76161]: INFO nova.virt.block_device [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Attempting to driver detach volume bf6ef675-607c-45f6-866c-f74f687b5065 from mountpoint /dev/vdc
Nov 14 18:04:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Attempting to detach device vdc from instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:04:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:04:40 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:04:40 user nova-compute[76161]:   <source dev="/dev/sdg"/>
Nov 14 18:04:40 user nova-compute[76161]:   <target dev="vdc" bus="virtio"/>
Nov 14 18:04:40 user nova-compute[76161]:   <serial>bf6ef675-607c-45f6-866c-f74f687b5065</serial>
Nov 14 18:04:40 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 18:04:40 user nova-compute[76161]: </disk>
Nov 14 18:04:40 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:04:40 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Successfully detached device vdc from instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff from the persistent domain config.
Nov 14 18:04:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:04:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:04:40 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:04:40 user nova-compute[76161]:   <source dev="/dev/sdg"/>
Nov 14 18:04:40 user nova-compute[76161]:   <target dev="vdc" bus="virtio"/>
Nov 14 18:04:40 user nova-compute[76161]:   <serial>bf6ef675-607c-45f6-866c-f74f687b5065</serial>
Nov 14 18:04:40 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 18:04:40 user nova-compute[76161]: </disk>
Nov 14 18:04:40 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:04:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:04:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:04:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:00 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff is timed out.
Nov 14 18:05:00 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Successfully detached device vdc from instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff from the live domain config.
Nov 14 18:05:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObUnwLTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:05:00 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:05:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c876d7-afbe-4379-a040-3083eafa91f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:05:00 user nova-compute[76161]: No targets found.
Nov 14 18:05:00 user nova-compute[76161]: iSNS:
Nov 14 18:05:00 user nova-compute[76161]: No targets found.
Nov 14 18:05:00 user nova-compute[76161]: STATIC:
Nov 14 18:05:00 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c
Nov 14 18:05:00 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:05:00 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:05:00 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:05:00 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:05:00 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:05:00 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:05:00 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:05:00 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:05:00 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:05:00 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:05:00 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:05:00 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065
Nov 14 18:05:00 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:05:00 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:05:00 user nova-compute[76161]: FIRMWARE:
Nov 14 18:05:00 user nova-compute[76161]: No targets found.
Nov 14 18:05:00 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:05:00 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:05:00 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4bda3f-1741-49d3-823a-47838857b0ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[725ea30b-a89e-4bcd-90b3-592b3926eb69]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:05:00 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:05:00 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:05:00 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:05:00 user nova-compute[76161]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c (non-flash)
Nov 14 18:05:00 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:05:00 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:05:00 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:05:00 user nova-compute[76161]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 (non-flash)
Nov 14 18:05:00 user nova-compute[76161]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c (non-flash)
Nov 14 18:05:00 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f8126e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065'): ({'sdg'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:05:00 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Removing single pathed devices sdg {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[07154acb-0583-4c47-860c-3a759dfeebfb]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf552c5b-c514-403d-9b65-4762aa9aae5e]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Flushing IO for device /dev/sdg {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f32fa9-39ea-4267-97f0-0cbc55acaa9a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1698c9-c2ec-4ae4-8cd9-88c308185fe9]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] SCSI volumes sdg have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.056s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[18811b96-b4ea-4015-b19a-2465afc62c80]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7013ce4e-a96e-426f-b798-56b4846944d0]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065, portal: 172.16.0.220,3260]
Nov 14 18:05:01 user nova-compute[76161]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065, portal: 172.16.0.220,3260] successful.
Nov 14 18:05:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6ef675-607c-45f6-866c-f74f687b5065 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b66c5ac-8bd5-42c3-8d42-0089406b2e3a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] <== disconnect_volume: return (333ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:05:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:05:02 user nova-compute[76161]: DEBUG nova.objects.instance [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'flavor' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-65286da8-6b0e-49a8-ad90-a8b7a7c16f92 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.682s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:03 user nova-compute[76161]: INFO nova.compute.manager [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Terminating instance
Nov 14 18:05:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-12050933-8484-4294-afc5-546369bdfd1a req-654d1ded-6e1d-4f47-8693-e2a512389c70 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Received event network-vif-unplugged-419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-12050933-8484-4294-afc5-546369bdfd1a req-654d1ded-6e1d-4f47-8693-e2a512389c70 service nova] Acquiring lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-12050933-8484-4294-afc5-546369bdfd1a req-654d1ded-6e1d-4f47-8693-e2a512389c70 service nova] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-12050933-8484-4294-afc5-546369bdfd1a req-654d1ded-6e1d-4f47-8693-e2a512389c70 service nova] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-12050933-8484-4294-afc5-546369bdfd1a req-654d1ded-6e1d-4f47-8693-e2a512389c70 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] No waiting events found dispatching network-vif-unplugged-419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-12050933-8484-4294-afc5-546369bdfd1a req-654d1ded-6e1d-4f47-8693-e2a512389c70 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Received event network-vif-unplugged-419e2daa-e52d-466a-aac8-097f313a3adc for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:05:04 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Instance destroyed successfully.
Nov 14 18:05:04 user nova-compute[76161]: DEBUG nova.objects.instance [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'resources' on Instance uuid fb619ab6-2509-45d4-8e1e-de40c8d0a07f {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1612669335',display_name='tempest-TestVolumeBootPattern-server-1612669335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1612669335',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-c2ap3qtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:03:31Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=fb619ab6-2509-45d4-8e1e-de40c8d0a07f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "419e2daa-e52d-466a-aac8-097f313a3adc", "address": "fa:16:3e:c5:6e:b8", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e2daa-e5", "ovs_interfaceid": "419e2daa-e52d-466a-aac8-097f313a3adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "419e2daa-e52d-466a-aac8-097f313a3adc", "address": "fa:16:3e:c5:6e:b8", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e2daa-e5", "ovs_interfaceid": "419e2daa-e52d-466a-aac8-097f313a3adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=419e2daa-e52d-466a-aac8-097f313a3adc,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e2daa-e5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_vif [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=419e2daa-e52d-466a-aac8-097f313a3adc,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e2daa-e5') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap419e2daa-e5, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1655e8a2-9132-4e2b-b43b-9c8281c893ed) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:04 user nova-compute[76161]: INFO os_vif [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:6e:b8,bridge_name='br-int',has_traffic_filtering=True,id=419e2daa-e52d-466a-aac8-097f313a3adc,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e2daa-e5')
Nov 14 18:05:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqKwDBUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:05:04 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6cbadb-9940-4fd5-9e64-cbb1ddba13f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:05:04 user nova-compute[76161]: No targets found.
Nov 14 18:05:04 user nova-compute[76161]: iSNS:
Nov 14 18:05:04 user nova-compute[76161]: No targets found.
Nov 14 18:05:04 user nova-compute[76161]: STATIC:
Nov 14 18:05:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c
Nov 14 18:05:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:05:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:05:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:05:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:05:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:05:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:05:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:05:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:05:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:05:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:05:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:05:04 user nova-compute[76161]: FIRMWARE:
Nov 14 18:05:04 user nova-compute[76161]: No targets found.
Nov 14 18:05:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:05:04 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:05:04 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[936ebaa0-e298-4648-a9f1-305d80739fb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e2d873-fccc-4124-9b73-cba18c0bcb55]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:05:04 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:05:04 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:05:04 user nova-compute[76161]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c (non-flash)
Nov 14 18:05:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:05:04 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:05:04 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:05:04 user nova-compute[76161]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c (non-flash)
Nov 14 18:05:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f8127e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[86190c92-9f6c-4cea-97e3-997dd7a5dc48]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3bd3d7-64f8-43a8-b0e2-d949d1454045]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaf086f-ea2e-4ba4-ab73-bee0700a59c2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.076s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[759fd639-de50-405f-b425-2156533bc751]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23566363131313733', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1a7a2d21', '/dev/disk/by-id/scsi-1SCST_BIO1a7a2d21-5f6111732f5cdcf9') {{(pid=86560) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[170e59ea-7da2-4105-bc0e-a61a61f5e099]: (4, None) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04003fb-7da3-4263-9690-9eda6172a458]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e93901-e61b-4322-bf62-18a4ef698942]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c, portal: 172.16.0.220,3260]
Nov 14 18:05:05 user nova-compute[76161]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c, portal: 172.16.0.220,3260] successful.
Nov 14 18:05:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86a846f-30eb-4fd1-a0c2-b631b313815c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[957d5c3f-a74c-415f-a409-0d61c864acb2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== disconnect_volume: return (350ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:05:05 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Deleting instance files /opt/stack/data/nova/instances/fb619ab6-2509-45d4-8e1e-de40c8d0a07f_del
Nov 14 18:05:05 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Deletion of /opt/stack/data/nova/instances/fb619ab6-2509-45d4-8e1e-de40c8d0a07f_del complete
Nov 14 18:05:05 user nova-compute[76161]: INFO nova.compute.manager [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 18:05:05 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:05 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:05:05 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Took 0.38 seconds to deallocate network for instance.
Nov 14 18:05:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-0a3e4e6e-bb92-46df-9ce6-e14b055e621b req-d8786c76-d3f5-4b41-9794-9d0fc4bee5b5 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Received event network-vif-deleted-419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:06 user nova-compute[76161]: INFO nova.compute.manager [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 18:05:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Deleting volume: c86a846f-30eb-4fd1-a0c2-b631b313815c {{(pid=76161) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-c9ae73ce-1fdf-4060-924e-f4696475bbfe req-74cf12c8-31ad-4bfd-9a99-cac1f6f857c9 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Received event network-vif-plugged-419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c9ae73ce-1fdf-4060-924e-f4696475bbfe req-74cf12c8-31ad-4bfd-9a99-cac1f6f857c9 service nova] Acquiring lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c9ae73ce-1fdf-4060-924e-f4696475bbfe req-74cf12c8-31ad-4bfd-9a99-cac1f6f857c9 service nova] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c9ae73ce-1fdf-4060-924e-f4696475bbfe req-74cf12c8-31ad-4bfd-9a99-cac1f6f857c9 service nova] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-c9ae73ce-1fdf-4060-924e-f4696475bbfe req-74cf12c8-31ad-4bfd-9a99-cac1f6f857c9 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] No waiting events found dispatching network-vif-plugged-419e2daa-e52d-466a-aac8-097f313a3adc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:05:06 user nova-compute[76161]: WARNING nova.compute.manager [req-c9ae73ce-1fdf-4060-924e-f4696475bbfe req-74cf12c8-31ad-4bfd-9a99-cac1f6f857c9 service nova] [instance: fb619ab6-2509-45d4-8e1e-de40c8d0a07f] Received unexpected event network-vif-plugged-419e2daa-e52d-466a-aac8-097f313a3adc for instance with vm_state active and task_state deleting.
Nov 14 18:05:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquired lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'info_cache' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG nova.objects.base [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:05:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:06 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Deleted allocations for instance fb619ab6-2509-45d4-8e1e-de40c8d0a07f
Nov 14 18:05:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-51464081-db63-41fd-892d-032cb570f930 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "fb619ab6-2509-45d4-8e1e-de40c8d0a07f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.915s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updating instance_info_cache with network_info: [{"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Releasing lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:05:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance destroyed successfully.
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'resources' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.objects.base [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1792224443',display_name='tempest-AttachVolumeTestJSON-server-1792224443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1792224443',id=24,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwTHCRRw1KxJLD9CcCs2gIwosvX+o4FaLgfSFYOuEANvq2aIipEcsGq1NHxa+NHKqWzzuxELOvKadsYZSKZeiQ7BOeCDXZ3VUvf4hvZmX1n4PdafIxgOfEgrSs9aoeq3Q==',key_name='tempest-keypair-1778122280',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-iw0i0sws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=75295499-8f99-4c9b-a556-c1287c61d8f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG os_vif [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9c3c5f8-f7, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c6434b6-0480-4bc4-8b26-6d2c7e332a22) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:07 user nova-compute[76161]: INFO os_vif [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7')
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Start _get_guest_xml network_info=[{"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'numa_topology' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.objects.base [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:05:07 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:05:07 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'vcpu_model' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.objects.base [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1792224443',display_name='tempest-AttachVolumeTestJSON-server-1792224443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1792224443',id=24,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwTHCRRw1KxJLD9CcCs2gIwosvX+o4FaLgfSFYOuEANvq2aIipEcsGq1NHxa+NHKqWzzuxELOvKadsYZSKZeiQ7BOeCDXZ3VUvf4hvZmX1n4PdafIxgOfEgrSs9aoeq3Q==',key_name='tempest-keypair-1778122280',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-iw0i0sws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=75295499-8f99-4c9b-a556-c1287c61d8f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'pci_devices' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.objects.base [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:05:07 user nova-compute[76161]:   <uuid>75295499-8f99-4c9b-a556-c1287c61d8f2</uuid>
Nov 14 18:05:07 user nova-compute[76161]:   <name>instance-00000018</name>
Nov 14 18:05:07 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:05:07 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:05:07 user nova-compute[76161]:   <metadata>
Nov 14 18:05:07 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:05:07 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:05:07 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeTestJSON-server-1792224443</nova:name>
Nov 14 18:05:07 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:05:07</nova:creationTime>
Nov 14 18:05:07 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:05:07 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:05:07 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:05:07 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:05:07 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:05:07 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:05:07 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:05:07 user nova-compute[76161]:       <nova:owner>
Nov 14 18:05:07 user nova-compute[76161]:         <nova:user uuid="89b7172f3aea4ef29587ca01c39be2f6">tempest-AttachVolumeTestJSON-1978358229-project-member</nova:user>
Nov 14 18:05:07 user nova-compute[76161]:         <nova:project uuid="0413439dcb2e49d496bf267c63163178">tempest-AttachVolumeTestJSON-1978358229</nova:project>
Nov 14 18:05:07 user nova-compute[76161]:       </nova:owner>
Nov 14 18:05:07 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:05:07 user nova-compute[76161]:       <nova:ports>
Nov 14 18:05:07 user nova-compute[76161]:         <nova:port uuid="d9c3c5f8-f77b-4475-9693-c63f6e310d19">
Nov 14 18:05:07 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 18:05:07 user nova-compute[76161]:         </nova:port>
Nov 14 18:05:07 user nova-compute[76161]:       </nova:ports>
Nov 14 18:05:07 user nova-compute[76161]:     </nova:instance>
Nov 14 18:05:07 user nova-compute[76161]:   </metadata>
Nov 14 18:05:07 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:05:07 user nova-compute[76161]:     <system>
Nov 14 18:05:07 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:05:07 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:05:07 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:05:07 user nova-compute[76161]:       <entry name="serial">75295499-8f99-4c9b-a556-c1287c61d8f2</entry>
Nov 14 18:05:07 user nova-compute[76161]:       <entry name="uuid">75295499-8f99-4c9b-a556-c1287c61d8f2</entry>
Nov 14 18:05:07 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:05:07 user nova-compute[76161]:     </system>
Nov 14 18:05:07 user nova-compute[76161]:   </sysinfo>
Nov 14 18:05:07 user nova-compute[76161]:   <os>
Nov 14 18:05:07 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:05:07 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:05:07 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:05:07 user nova-compute[76161]:   </os>
Nov 14 18:05:07 user nova-compute[76161]:   <features>
Nov 14 18:05:07 user nova-compute[76161]:     <acpi/>
Nov 14 18:05:07 user nova-compute[76161]:     <apic/>
Nov 14 18:05:07 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:05:07 user nova-compute[76161]:   </features>
Nov 14 18:05:07 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:05:07 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:05:07 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:05:07 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:05:07 user nova-compute[76161]:   </clock>
Nov 14 18:05:07 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:05:07 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:05:07 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:05:07 user nova-compute[76161]:   </cpu>
Nov 14 18:05:07 user nova-compute[76161]:   <devices>
Nov 14 18:05:07 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:05:07 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:05:07 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk"/>
Nov 14 18:05:07 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:05:07 user nova-compute[76161]:     </disk>
Nov 14 18:05:07 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:05:07 user nova-compute[76161]:       <mac address="fa:16:3e:38:ed:cd"/>
Nov 14 18:05:07 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:05:07 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:05:07 user nova-compute[76161]:       <target dev="tapd9c3c5f8-f7"/>
Nov 14 18:05:07 user nova-compute[76161]:     </interface>
Nov 14 18:05:07 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:05:07 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/console.log" append="off"/>
Nov 14 18:05:07 user nova-compute[76161]:     </serial>
Nov 14 18:05:07 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:05:07 user nova-compute[76161]:     <video>
Nov 14 18:05:07 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:05:07 user nova-compute[76161]:     </video>
Nov 14 18:05:07 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:05:07 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:05:07 user nova-compute[76161]:     </rng>
Nov 14 18:05:07 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:05:07 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:05:07 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:05:07 user nova-compute[76161]:     </memballoon>
Nov 14 18:05:07 user nova-compute[76161]:   </devices>
Nov 14 18:05:07 user nova-compute[76161]: </domain>
Nov 14 18:05:07 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'trusted_certs' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.objects.base [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.212s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:05:07 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Cannot resize image /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'migration_context' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG nova.objects.base [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Object Instance<75295499-8f99-4c9b-a556-c1287c61d8f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1792224443',display_name='tempest-AttachVolumeTestJSON-server-1792224443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1792224443',id=24,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwTHCRRw1KxJLD9CcCs2gIwosvX+o4FaLgfSFYOuEANvq2aIipEcsGq1NHxa+NHKqWzzuxELOvKadsYZSKZeiQ7BOeCDXZ3VUvf4hvZmX1n4PdafIxgOfEgrSs9aoeq3Q==',key_name='tempest-keypair-1778122280',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-iw0i0sws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=75295499-8f99-4c9b-a556-c1287c61d8f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG os_vif [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f60c8db-9b1f-594b-bb34-d3400478db28', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9c3c5f8-f7, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9c3c5f8-f7, col_values=(('qos', UUID('1ce0013d-c2d7-4b26-9efa-5c2aedf380b9')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9c3c5f8-f7, col_values=(('external_ids', {'iface-id': 'd9c3c5f8-f77b-4475-9693-c63f6e310d19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ed:cd', 'vm-uuid': '75295499-8f99-4c9b-a556-c1287c61d8f2'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:05:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:08 user nova-compute[76161]: INFO os_vif [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7')
Nov 14 18:05:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-50d269dd-7cd0-47b0-aece-f0d1f39217ff req-ef6e9920-2589-44e2-92b6-82743ef83026 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50d269dd-7cd0-47b0-aece-f0d1f39217ff req-ef6e9920-2589-44e2-92b6-82743ef83026 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50d269dd-7cd0-47b0-aece-f0d1f39217ff req-ef6e9920-2589-44e2-92b6-82743ef83026 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-50d269dd-7cd0-47b0-aece-f0d1f39217ff req-ef6e9920-2589-44e2-92b6-82743ef83026 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-50d269dd-7cd0-47b0-aece-f0d1f39217ff req-ef6e9920-2589-44e2-92b6-82743ef83026 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:05:09 user nova-compute[76161]: WARNING nova.compute.manager [req-50d269dd-7cd0-47b0-aece-f0d1f39217ff req-ef6e9920-2589-44e2-92b6-82743ef83026 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state stopped and task_state powering-on.
Nov 14 18:05:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:11 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:05:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance rebooted successfully.
Nov 14 18:05:11 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6d0dfbf1-f80a-4989-b15f-5801b06e140f tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:05:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-5886ba24-04d5-42d0-8a2a-4164913f9ac3 req-0f033590-eebe-49a4-be5a-28e3d7394d5d service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5886ba24-04d5-42d0-8a2a-4164913f9ac3 req-0f033590-eebe-49a4-be5a-28e3d7394d5d service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5886ba24-04d5-42d0-8a2a-4164913f9ac3 req-0f033590-eebe-49a4-be5a-28e3d7394d5d service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5886ba24-04d5-42d0-8a2a-4164913f9ac3 req-0f033590-eebe-49a4-be5a-28e3d7394d5d service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-5886ba24-04d5-42d0-8a2a-4164913f9ac3 req-0f033590-eebe-49a4-be5a-28e3d7394d5d service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:05:11 user nova-compute[76161]: WARNING nova.compute.manager [req-5886ba24-04d5-42d0-8a2a-4164913f9ac3 req-0f033590-eebe-49a4-be5a-28e3d7394d5d service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state active and task_state None.
Nov 14 18:05:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:19 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:19 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:19 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:05:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:05:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:05:20 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:05:20 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updating instance_info_cache with network_info: [{"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:05:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-75295499-8f99-4c9b-a556-c1287c61d8f2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:05:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:05:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:05:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:24 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:29 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:05:29 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7469MB free_disk=24.949974060058594GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 75295499-8f99-4c9b-a556-c1287c61d8f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 385ef873-fc1f-46ae-90da-b75f82524b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance cd162511-a09b-4479-8d29-0a5a4b40ae78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0a5d3ce-4564-434d-9650-36548fb33ab0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing inventories for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating ProviderTree inventory for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing aggregate associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, aggregates: None {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 18:05:29 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing trait associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.771s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] There are 0 instances to clean {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:30 user nova-compute[76161]: INFO nova.compute.manager [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Terminating instance
Nov 14 18:05:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-fa81d352-ea2f-4057-b1e4-47c1182f2417 req-460ff646-1f1a-4728-89b9-1e85d778f28b service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-vif-unplugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fa81d352-ea2f-4057-b1e4-47c1182f2417 req-460ff646-1f1a-4728-89b9-1e85d778f28b service nova] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fa81d352-ea2f-4057-b1e4-47c1182f2417 req-460ff646-1f1a-4728-89b9-1e85d778f28b service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fa81d352-ea2f-4057-b1e4-47c1182f2417 req-460ff646-1f1a-4728-89b9-1e85d778f28b service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-fa81d352-ea2f-4057-b1e4-47c1182f2417 req-460ff646-1f1a-4728-89b9-1e85d778f28b service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] No waiting events found dispatching network-vif-unplugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-fa81d352-ea2f-4057-b1e4-47c1182f2417 req-460ff646-1f1a-4728-89b9-1e85d778f28b service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-vif-unplugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:05:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Instance destroyed successfully.
Nov 14 18:05:31 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'resources' on Instance uuid 72ea8ec0-29d3-49f1-bd61-7047aabfbaff {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T17:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1148321708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1148321708',id=32,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWDC5huzIpKEHV7/Vtzw1d40g9OR0Xm02D0MURyQiuMKFJcZ6JPA6YiqIW1t7K6sD6LZw3Pp8mE2Ox2eP8kBTzl19n94U5ATtytTpddmzWU30WOCt5Vh7+HiX5AzmSg3g==',key_name='tempest-keypair-926458659',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:03:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-fw12nx7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=72ea8ec0-29d3-49f1-bd61-7047aabfbaff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "address": "fa:16:3e:b2:ce:91", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e4ef5f-6f", "ovs_interfaceid": "61e4ef5f-6fe5-430d-aeb6-af8dfa723f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG os_vif [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61e4ef5f-6f, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0e1cfae-1859-4012-baea-2139912356c2) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:05:31 user nova-compute[76161]: INFO os_vif [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ce:91,bridge_name='br-int',has_traffic_filtering=True,id=61e4ef5f-6fe5-430d-aeb6-af8dfa723f53,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e4ef5f-6f')
Nov 14 18:05:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Deleting instance files /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff_del
Nov 14 18:05:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Deletion of /opt/stack/data/nova/instances/72ea8ec0-29d3-49f1-bd61-7047aabfbaff_del complete
Nov 14 18:05:31 user nova-compute[76161]: INFO nova.compute.manager [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 18:05:31 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:05:31 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:05:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:32 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:05:32 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Took 0.86 seconds to deallocate network for instance.
Nov 14 18:05:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-73776ee3-daf6-473f-9fe4-8596e13c3f61 req-5ea8d756-757f-4c28-ae1d-b8e8840cf2ce service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-vif-deleted-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:32 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:05:32 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:05:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:32 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Deleted allocations for instance 72ea8ec0-29d3-49f1-bd61-7047aabfbaff
Nov 14 18:05:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2bd4b4a6-23fe-4ca6-8896-7562f16aaa09 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] Acquiring lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] Lock "72ea8ec0-29d3-49f1-bd61-7047aabfbaff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] No waiting events found dispatching network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:05:33 user nova-compute[76161]: WARNING nova.compute.manager [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] [instance: 72ea8ec0-29d3-49f1-bd61-7047aabfbaff] Received unexpected event network-vif-plugged-61e4ef5f-6fe5-430d-aeb6-af8dfa723f53 for instance with vm_state deleted and task_state None.
Nov 14 18:05:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received event network-changed-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Refreshing instance network info cache due to event network-changed-9c1e8d73-f859-469b-9e3d-3be83cbbe22c. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] Acquiring lock "refresh_cache-236486e6-e33d-4027-a91e-dd2c6cb20ce7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] Acquired lock "refresh_cache-236486e6-e33d-4027-a91e-dd2c6cb20ce7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG nova.network.neutron [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Refreshing network info cache for port 9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG nova.network.neutron [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Updated VIF entry in instance network info cache for port 9c1e8d73-f859-469b-9e3d-3be83cbbe22c. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG nova.network.neutron [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Updating instance_info_cache with network_info: [{"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:05:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-86442491-3f17-480e-80d9-e4df834226ae req-e0e43526-b1d1-49b5-ac0e-f49ac121023f service nova] Releasing lock "refresh_cache-236486e6-e33d-4027-a91e-dd2c6cb20ce7" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'flavor' on Instance uuid 236486e6-e33d-4027-a91e-dd2c6cb20ce7 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76161) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:34 user nova-compute[76161]: INFO nova.compute.manager [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Attaching volume 8c722b3f-bf04-4b25-b083-0df48f62f4f3 to /dev/vdb
Nov 14 18:05:34 user nova-compute[76161]: DEBUG os_brick.utils [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[930953b4-fac9-4250-b3b3-b2cd9d4c6424]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b674a0-3e32-40c3-b554-905cb6471890]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8bcbd5-1a33-4ba1-877d-77cca4c90886]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b0091-dc71-4f58-a0dc-e838e0afbd81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:05:34 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:05:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4030e6-3495-4583-8014-da884cb55cb8]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG os_brick.utils [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:05:34 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Updating existing volume attachment record: de2f9efc-69e5-4d5c-96e7-1bea24da0ebe {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:05:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 1040ce71-437b-4398-9bb5-bd34e86589a7 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 385ef873-fc1f-46ae-90da-b75f82524b99 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid de90c284-3d97-42c6-9692-cdac8eccd2ef {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid a0a5d3ce-4564-434d-9650-36548fb33ab0 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid cd162511-a09b-4479-8d29-0a5a4b40ae78 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 236486e6-e33d-4027-a91e-dd2c6cb20ce7 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "1040ce71-437b-4398-9bb5-bd34e86589a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "385ef873-fc1f-46ae-90da-b75f82524b99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "385ef873-fc1f-46ae-90da-b75f82524b99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "385ef873-fc1f-46ae-90da-b75f82524b99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:36 user nova-compute[76161]: INFO nova.compute.manager [None req-9f356fdd-8baf-405d-8091-93d2ecc5914d tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Unrescuing
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9f356fdd-8baf-405d-8091-93d2ecc5914d tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9f356fdd-8baf-405d-8091-93d2ecc5914d tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquired lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9f356fdd-8baf-405d-8091-93d2ecc5914d tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:05:36 user nova-compute[76161]: DEBUG nova.network.neutron [None req-9f356fdd-8baf-405d-8091-93d2ecc5914d tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updating instance_info_cache with network_info: [{"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9f356fdd-8baf-405d-8091-93d2ecc5914d tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Releasing lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG nova.objects.instance [None req-9f356fdd-8baf-405d-8091-93d2ecc5914d tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'flavor' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-ad2f5d75-0346-4db4-b3a4-8efa25cbd673 req-94885778-22e5-4d6b-8518-119350aa8853 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-unplugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ad2f5d75-0346-4db4-b3a4-8efa25cbd673 req-94885778-22e5-4d6b-8518-119350aa8853 service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ad2f5d75-0346-4db4-b3a4-8efa25cbd673 req-94885778-22e5-4d6b-8518-119350aa8853 service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ad2f5d75-0346-4db4-b3a4-8efa25cbd673 req-94885778-22e5-4d6b-8518-119350aa8853 service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-ad2f5d75-0346-4db4-b3a4-8efa25cbd673 req-94885778-22e5-4d6b-8518-119350aa8853 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-unplugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:05:37 user nova-compute[76161]: WARNING nova.compute.manager [req-ad2f5d75-0346-4db4-b3a4-8efa25cbd673 req-94885778-22e5-4d6b-8518-119350aa8853 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-unplugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:05:37 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Instance destroyed successfully.
Nov 14 18:05:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNptdsbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:05:38 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:05:38 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:05:38 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4eb864-994a-485e-b1e1-5d7daf461864]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:05:38 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[88746afd-c74d-422f-9d13-b919d9d500c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3] added
Nov 14 18:05:38 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d27bb-96ec-42ef-ae71-ac525baff594]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[41126a9f-a5aa-43db-b52f-bf9ee3b0dc41]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNptdsbQ {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNptdsbQ" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7b27fb-afd4-4efa-8891-0b6f104a1355]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cNptdsbQ'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[41baf86c-f66f-4ce2-8a78-1d7abb1cc59c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[38820d27-49df-41a6-a867-26e0d7662370]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:05:38 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:05:38 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:05:38 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:05:38 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:05:38 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:05:38 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:05:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ba33f-e1cb-4bf0-bb11-573bd13431d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3, portal: 172.16.0.220,3260]
Nov 14 18:05:39 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3, portal: 172.16.0.220,3260] successful.
Nov 14 18:05:39 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b992765-d76d-4b86-b544-9fcac1e46f81]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[471df9c7-a7ea-4d73-8c03-94908c238d8f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:05:39 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:05:39 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:05:39 user nova-compute[76161]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 (non-flash)
Nov 14 18:05:39 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:05:39 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:05:39 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:05:39 user nova-compute[76161]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 (non-flash)
Nov 14 18:05:39 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[176dc32a-9647-4aa7-ae61-0e2a1bdf13d5]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNptdsbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:05:39 user nova-compute[76161]: WARNING nova.compute.manager [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:05:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:05:39 user nova-compute[76161]: WARNING nova.compute.manager [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:05:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:05:39 user nova-compute[76161]: WARNING nova.compute.manager [req-3ab70260-83d8-4a66-b261-e8bf34d15c79 req-59e450d3-6c00-40c7-911b-deb2e24d9ede service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:05:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26665346362316365', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665346362316365', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG nova.objects.instance [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'flavor' on Instance uuid 236486e6-e33d-4027-a91e-dd2c6cb20ce7 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:05:40 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:05:40 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:05:40 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:05:40 user nova-compute[76161]:   <serial>8c722b3f-bf04-4b25-b083-0df48f62f4f3</serial>
Nov 14 18:05:40 user nova-compute[76161]: </disk>
Nov 14 18:05:40 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] No VIF found with MAC fa:16:3e:e2:0f:f4, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-30ff2586-c40d-41b9-99ad-2d71114d4d4d tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.330s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.331s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:05:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:05:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:05:41 user nova-compute[76161]: INFO nova.compute.manager [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Detaching volume 8c722b3f-bf04-4b25-b083-0df48f62f4f3
Nov 14 18:05:41 user nova-compute[76161]: INFO nova.virt.block_device [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Attempting to driver detach volume 8c722b3f-bf04-4b25-b083-0df48f62f4f3 from mountpoint /dev/vdb
Nov 14 18:05:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Attempting to detach device vdb from instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:05:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:05:41 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:05:41 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:05:41 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:05:41 user nova-compute[76161]:   <serial>8c722b3f-bf04-4b25-b083-0df48f62f4f3</serial>
Nov 14 18:05:41 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:05:41 user nova-compute[76161]: </disk>
Nov 14 18:05:41 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:05:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully detached device vdb from instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7 from the persistent domain config.
Nov 14 18:05:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:05:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:05:41 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:05:41 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:05:41 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:05:41 user nova-compute[76161]:   <serial>8c722b3f-bf04-4b25-b083-0df48f62f4f3</serial>
Nov 14 18:05:41 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:05:41 user nova-compute[76161]: </disk>
Nov 14 18:05:41 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:05:41 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9f356fdd-8baf-405d-8091-93d2ecc5914d tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:05:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:41 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:05:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:05:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:05:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:01 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7 is timed out.
Nov 14 18:06:01 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully detached device vdb from instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7 from the live domain config.
Nov 14 18:06:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNptdsbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:06:01 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d569b6ab-d53a-4f24-932f-dfadfa1c8995]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:06:01 user nova-compute[76161]: No targets found.
Nov 14 18:06:01 user nova-compute[76161]: iSNS:
Nov 14 18:06:01 user nova-compute[76161]: No targets found.
Nov 14 18:06:01 user nova-compute[76161]: STATIC:
Nov 14 18:06:01 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:06:01 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:06:01 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:06:01 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:06:01 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:06:01 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:06:01 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:06:01 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:06:01 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:06:01 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3
Nov 14 18:06:01 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:06:01 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:06:01 user nova-compute[76161]: FIRMWARE:
Nov 14 18:06:01 user nova-compute[76161]: No targets found.
Nov 14 18:06:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:06:01 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:06:01 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1195752-1b39-4135-82c2-35fc374c2879]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[07371332-f3a0-4fbd-bd91-c72deb1841ac]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:06:01 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:06:01 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:06:01 user nova-compute[76161]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 (non-flash)
Nov 14 18:06:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:06:01 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:06:01 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:06:01 user nova-compute[76161]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 (non-flash)
Nov 14 18:06:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f841da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[39783265-f107-49a8-a571-5a269d05c0f0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de1f539-522d-406a-9565-2decb972fbb2]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd6e339-bcce-4def-a379-7d217726568a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf817b12-6a44-44fc-8b0d-cd2718459163]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb7717a-4535-4b0d-a3a8-9ac6712165ef]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[07305092-17bc-4474-8464-991e9a605384]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3, portal: 172.16.0.220,3260]
Nov 14 18:06:01 user nova-compute[76161]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3, portal: 172.16.0.220,3260] successful.
Nov 14 18:06:01 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c722b3f-bf04-4b25-b083-0df48f62f4f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cc28a1-dede-430e-a60d-17cb75da7350]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] <== disconnect_volume: return (300ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:06:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:06:02 user nova-compute[76161]: DEBUG nova.objects.instance [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'flavor' on Instance uuid 236486e6-e33d-4027-a91e-dd2c6cb20ce7 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:06:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-def57e50-a646-4bd2-aee7-57bc942f2b54 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.821s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "a0ec5fe2-517b-498c-8606-9417432c8803" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "a0ec5fe2-517b-498c-8606-9417432c8803" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:06:03 user nova-compute[76161]: INFO nova.compute.claims [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Claim successful on node user
Nov 14 18:06:03 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:06:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:06:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG nova.policy [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd22a86988e6043d2ab950e0d6e557ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81682e21827c4572b1659004cc22215a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:06:03 user nova-compute[76161]: INFO nova.virt.block_device [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Booting with volume 38f74f42-74d9-415a-93ee-49395d621eea at /dev/vda
Nov 14 18:06:03 user nova-compute[76161]: DEBUG os_brick.utils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[84125c89-9ff8-49e3-bfdf-8f952033676c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[510b8e3d-2b25-48fa-bbd5-f4bbfdf16713]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ddd9af-b0e6-4e0c-a857-7d7379e8fe25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7345bdc6-09ff-4ef2-af78-f51d51fd406a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:06:03 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:06:03 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a345bc90-cdbf-44e3-a7d9-e87999a702c5]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG os_brick.utils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:06:03 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Updating existing volume attachment record: a1d319e1-8d18-4deb-8e59-6541053cdb16 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:06:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Successfully created port: fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:06:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Successfully updated port: fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:06:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "refresh_cache-a0ec5fe2-517b-498c-8606-9417432c8803" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:06:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquired lock "refresh_cache-a0ec5fe2-517b-498c-8606-9417432c8803" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:06:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:06:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-d0ab17cd-4e04-477f-8676-7a564401db9c req-d79e24fb-32cc-44e3-a407-429be368c1c1 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received event network-changed-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-d0ab17cd-4e04-477f-8676-7a564401db9c req-d79e24fb-32cc-44e3-a407-429be368c1c1 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Refreshing instance network info cache due to event network-changed-fbdc6a40-096f-4f70-8a59-a478924938ad. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:06:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0ab17cd-4e04-477f-8676-7a564401db9c req-d79e24fb-32cc-44e3-a407-429be368c1c1 service nova] Acquiring lock "refresh_cache-a0ec5fe2-517b-498c-8606-9417432c8803" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:06:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:06:05 user nova-compute[76161]: DEBUG nova.network.neutron [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Updating instance_info_cache with network_info: [{"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:06:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Releasing lock "refresh_cache-a0ec5fe2-517b-498c-8606-9417432c8803" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:06:05 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Instance network_info: |[{"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:06:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0ab17cd-4e04-477f-8676-7a564401db9c req-d79e24fb-32cc-44e3-a407-429be368c1c1 service nova] Acquired lock "refresh_cache-a0ec5fe2-517b-498c-8606-9417432c8803" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:06:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-d0ab17cd-4e04-477f-8676-7a564401db9c req-d79e24fb-32cc-44e3-a407-429be368c1c1 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Refreshing network info cache for port fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:06:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-d0ab17cd-4e04-477f-8676-7a564401db9c req-d79e24fb-32cc-44e3-a407-429be368c1c1 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Updated VIF entry in instance network info cache for port fbdc6a40-096f-4f70-8a59-a478924938ad. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:06:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-d0ab17cd-4e04-477f-8676-7a564401db9c req-d79e24fb-32cc-44e3-a407-429be368c1c1 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Updating instance_info_cache with network_info: [{"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:06:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0ab17cd-4e04-477f-8676-7a564401db9c req-d79e24fb-32cc-44e3-a407-429be368c1c1 service nova] Releasing lock "refresh_cache-a0ec5fe2-517b-498c-8606-9417432c8803" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:06:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:06:08 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Creating image(s)
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Ensure instance console log exists: /opt/stack/data/nova/instances/a0ec5fe2-517b-498c-8606-9417432c8803/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Start _get_guest_xml network_info=[{"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoCiAcUd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a0ec5fe2-517b-498c-8606-9417432c8803', 'attached_at': '', 'detached_at': '', 'volume_id': '38f74f42-74d9-415a-93ee-49395d621eea', 'serial': '38f74f42-74d9-415a-93ee-49395d621eea'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'a1d319e1-8d18-4deb-8e59-6541053cdb16', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:06:08 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:06:08 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoCiAcUd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:06:08 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:06:08 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:06:08 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[749867ac-2361-4e29-848e-deaade365b06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:06:08 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[084b2278-9db2-4b29-abd5-591181af79c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea] added
Nov 14 18:06:08 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6af8f8-d3e6-4fd4-b789-433a0cf18d31]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23f89db-0e5c-4249-90e8-2d0b0d6ecaa3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IoCiAcUd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IoCiAcUd" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b038e6-3f62-413f-8ed9-4f68ba0c1781]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IoCiAcUd'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3630d8-1a30-4f52-ab17-0c31aea3ca4d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f818947-da29-4a7a-89dc-c3cae43ce619]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:06:08 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:06:08 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:06:08 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:06:08 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:06:08 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:06:08 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bf3b8d-552a-4ebd-b57a-f222da86ede8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea, portal: 172.16.0.220,3260]
Nov 14 18:06:08 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea, portal: 172.16.0.220,3260] successful.
Nov 14 18:06:08 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f75abad-d09b-44a4-a22d-18f65511dd7b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6136b1db-eced-45de-9c07-9a7e6f4b5c96]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:06:08 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:06:08 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:06:08 user nova-compute[76161]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:06:08 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:06:08 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:06:08 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:06:08 user nova-compute[76161]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:06:08 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[343afe0a-5baf-4914-aad0-a8f181cf07c2]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:08 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoCiAcUd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26666333661363664', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666333661363664', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1291280286',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1291280286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1291280286',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfNSbhXXnYI8neJ3qtubOKUzNy8IKMoHa/oFqyhpscePdLtzld8SeKTMwtclpNlwsRwTlZBMEdjlYeZ5/1RyXaEVDbxD1Td+6BK1iWGWslsXAMS48piWanWtc4xCN8Yaw==',key_name='tempest-keypair-1070313770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-4xsa5300',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:06:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=a0ec5fe2-517b-498c-8606-9417432c8803,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:38:9a,bridge_name='br-int',has_traffic_filtering=True,id=fbdc6a40-096f-4f70-8a59-a478924938ad,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbdc6a40-09') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.objects.instance [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'pci_devices' on Instance uuid a0ec5fe2-517b-498c-8606-9417432c8803 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:06:09 user nova-compute[76161]:   <uuid>a0ec5fe2-517b-498c-8606-9417432c8803</uuid>
Nov 14 18:06:09 user nova-compute[76161]:   <name>instance-00000027</name>
Nov 14 18:06:09 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:06:09 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:06:09 user nova-compute[76161]:   <metadata>
Nov 14 18:06:09 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:06:09 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:06:09 user nova-compute[76161]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1291280286</nova:name>
Nov 14 18:06:09 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:06:08</nova:creationTime>
Nov 14 18:06:09 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:06:09 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:06:09 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:06:09 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:06:09 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:06:09 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:06:09 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:06:09 user nova-compute[76161]:       <nova:owner>
Nov 14 18:06:09 user nova-compute[76161]:         <nova:user uuid="d22a86988e6043d2ab950e0d6e557ef8">tempest-TestVolumeBootPattern-1727647616-project-member</nova:user>
Nov 14 18:06:09 user nova-compute[76161]:         <nova:project uuid="81682e21827c4572b1659004cc22215a">tempest-TestVolumeBootPattern-1727647616</nova:project>
Nov 14 18:06:09 user nova-compute[76161]:       </nova:owner>
Nov 14 18:06:09 user nova-compute[76161]:       <nova:ports>
Nov 14 18:06:09 user nova-compute[76161]:         <nova:port uuid="fbdc6a40-096f-4f70-8a59-a478924938ad">
Nov 14 18:06:09 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 18:06:09 user nova-compute[76161]:         </nova:port>
Nov 14 18:06:09 user nova-compute[76161]:       </nova:ports>
Nov 14 18:06:09 user nova-compute[76161]:     </nova:instance>
Nov 14 18:06:09 user nova-compute[76161]:   </metadata>
Nov 14 18:06:09 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:06:09 user nova-compute[76161]:     <system>
Nov 14 18:06:09 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:06:09 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:06:09 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:06:09 user nova-compute[76161]:       <entry name="serial">a0ec5fe2-517b-498c-8606-9417432c8803</entry>
Nov 14 18:06:09 user nova-compute[76161]:       <entry name="uuid">a0ec5fe2-517b-498c-8606-9417432c8803</entry>
Nov 14 18:06:09 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:06:09 user nova-compute[76161]:     </system>
Nov 14 18:06:09 user nova-compute[76161]:   </sysinfo>
Nov 14 18:06:09 user nova-compute[76161]:   <os>
Nov 14 18:06:09 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:06:09 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:06:09 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:06:09 user nova-compute[76161]:   </os>
Nov 14 18:06:09 user nova-compute[76161]:   <features>
Nov 14 18:06:09 user nova-compute[76161]:     <acpi/>
Nov 14 18:06:09 user nova-compute[76161]:     <apic/>
Nov 14 18:06:09 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:06:09 user nova-compute[76161]:   </features>
Nov 14 18:06:09 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:06:09 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:06:09 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:06:09 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:06:09 user nova-compute[76161]:   </clock>
Nov 14 18:06:09 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:06:09 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:06:09 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:06:09 user nova-compute[76161]:   </cpu>
Nov 14 18:06:09 user nova-compute[76161]:   <devices>
Nov 14 18:06:09 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:06:09 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:06:09 user nova-compute[76161]:       <source dev="/dev/sdb"/>
Nov 14 18:06:09 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:06:09 user nova-compute[76161]:       <serial>38f74f42-74d9-415a-93ee-49395d621eea</serial>
Nov 14 18:06:09 user nova-compute[76161]:     </disk>
Nov 14 18:06:09 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:06:09 user nova-compute[76161]:       <mac address="fa:16:3e:02:38:9a"/>
Nov 14 18:06:09 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:06:09 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:06:09 user nova-compute[76161]:       <target dev="tapfbdc6a40-09"/>
Nov 14 18:06:09 user nova-compute[76161]:     </interface>
Nov 14 18:06:09 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:06:09 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/a0ec5fe2-517b-498c-8606-9417432c8803/console.log" append="off"/>
Nov 14 18:06:09 user nova-compute[76161]:     </serial>
Nov 14 18:06:09 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:06:09 user nova-compute[76161]:     <video>
Nov 14 18:06:09 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:06:09 user nova-compute[76161]:     </video>
Nov 14 18:06:09 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:06:09 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:06:09 user nova-compute[76161]:     </rng>
Nov 14 18:06:09 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:06:09 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:06:09 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:06:09 user nova-compute[76161]:     </memballoon>
Nov 14 18:06:09 user nova-compute[76161]:   </devices>
Nov 14 18:06:09 user nova-compute[76161]: </domain>
Nov 14 18:06:09 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1291280286',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1291280286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1291280286',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfNSbhXXnYI8neJ3qtubOKUzNy8IKMoHa/oFqyhpscePdLtzld8SeKTMwtclpNlwsRwTlZBMEdjlYeZ5/1RyXaEVDbxD1Td+6BK1iWGWslsXAMS48piWanWtc4xCN8Yaw==',key_name='tempest-keypair-1070313770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-4xsa5300',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:06:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=a0ec5fe2-517b-498c-8606-9417432c8803,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:38:9a,bridge_name='br-int',has_traffic_filtering=True,id=fbdc6a40-096f-4f70-8a59-a478924938ad,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbdc6a40-09') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG os_vif [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:38:9a,bridge_name='br-int',has_traffic_filtering=True,id=fbdc6a40-096f-4f70-8a59-a478924938ad,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbdc6a40-09') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66262c8d-7cfe-5bea-834c-3335dba82393', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbdc6a40-09, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbdc6a40-09, col_values=(('qos', UUID('7df7a188-1a38-441c-ae0c-feb906721e8a')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbdc6a40-09, col_values=(('external_ids', {'iface-id': 'fbdc6a40-096f-4f70-8a59-a478924938ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:38:9a', 'vm-uuid': 'a0ec5fe2-517b-498c-8606-9417432c8803'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:09 user nova-compute[76161]: INFO os_vif [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:38:9a,bridge_name='br-int',has_traffic_filtering=True,id=fbdc6a40-096f-4f70-8a59-a478924938ad,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbdc6a40-09')
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:06:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No VIF found with MAC fa:16:3e:02:38:9a, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:06:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-8e6666a7-2087-43bb-bed2-9ac9116aa07d req-bea15aaa-1328-4372-ae5a-c116da0a1eb0 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received event network-vif-plugged-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8e6666a7-2087-43bb-bed2-9ac9116aa07d req-bea15aaa-1328-4372-ae5a-c116da0a1eb0 service nova] Acquiring lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8e6666a7-2087-43bb-bed2-9ac9116aa07d req-bea15aaa-1328-4372-ae5a-c116da0a1eb0 service nova] Lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8e6666a7-2087-43bb-bed2-9ac9116aa07d req-bea15aaa-1328-4372-ae5a-c116da0a1eb0 service nova] Lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-8e6666a7-2087-43bb-bed2-9ac9116aa07d req-bea15aaa-1328-4372-ae5a-c116da0a1eb0 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] No waiting events found dispatching network-vif-plugged-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:06:11 user nova-compute[76161]: WARNING nova.compute.manager [req-8e6666a7-2087-43bb-bed2-9ac9116aa07d req-bea15aaa-1328-4372-ae5a-c116da0a1eb0 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received unexpected event network-vif-plugged-fbdc6a40-096f-4f70-8a59-a478924938ad for instance with vm_state building and task_state spawning.
Nov 14 18:06:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:06:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Instance spawned successfully.
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:13 user nova-compute[76161]: INFO nova.compute.manager [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-66978d57-df1f-45c3-b89b-fb547744e6c8 req-4cd87dd9-0ac2-4edc-95ad-f82fa27045a6 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received event network-vif-plugged-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-66978d57-df1f-45c3-b89b-fb547744e6c8 req-4cd87dd9-0ac2-4edc-95ad-f82fa27045a6 service nova] Acquiring lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-66978d57-df1f-45c3-b89b-fb547744e6c8 req-4cd87dd9-0ac2-4edc-95ad-f82fa27045a6 service nova] Lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-66978d57-df1f-45c3-b89b-fb547744e6c8 req-4cd87dd9-0ac2-4edc-95ad-f82fa27045a6 service nova] Lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-66978d57-df1f-45c3-b89b-fb547744e6c8 req-4cd87dd9-0ac2-4edc-95ad-f82fa27045a6 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] No waiting events found dispatching network-vif-plugged-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:06:13 user nova-compute[76161]: WARNING nova.compute.manager [req-66978d57-df1f-45c3-b89b-fb547744e6c8 req-4cd87dd9-0ac2-4edc-95ad-f82fa27045a6 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received unexpected event network-vif-plugged-fbdc6a40-096f-4f70-8a59-a478924938ad for instance with vm_state building and task_state spawning.
Nov 14 18:06:13 user nova-compute[76161]: INFO nova.compute.manager [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Took 10.44 seconds to build instance.
Nov 14 18:06:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-cee65e40-af8f-4c1d-a221-a70ca7764e99 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "a0ec5fe2-517b-498c-8606-9417432c8803" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.528s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:06:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-385ef873-fc1f-46ae-90da-b75f82524b99" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-385ef873-fc1f-46ae-90da-b75f82524b99" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Updating instance_info_cache with network_info: [{"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-385ef873-fc1f-46ae-90da-b75f82524b99" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:21 user nova-compute[76161]: INFO nova.compute.manager [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Terminating instance
Nov 14 18:06:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-52cc9f63-ed53-4d7f-a3dd-ec5b7c842dd7 req-581b270d-6b77-4650-90e6-950dd824ff6b service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-unplugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-52cc9f63-ed53-4d7f-a3dd-ec5b7c842dd7 req-581b270d-6b77-4650-90e6-950dd824ff6b service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-52cc9f63-ed53-4d7f-a3dd-ec5b7c842dd7 req-581b270d-6b77-4650-90e6-950dd824ff6b service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-52cc9f63-ed53-4d7f-a3dd-ec5b7c842dd7 req-581b270d-6b77-4650-90e6-950dd824ff6b service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-52cc9f63-ed53-4d7f-a3dd-ec5b7c842dd7 req-581b270d-6b77-4650-90e6-950dd824ff6b service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-unplugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-52cc9f63-ed53-4d7f-a3dd-ec5b7c842dd7 req-581b270d-6b77-4650-90e6-950dd824ff6b service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-unplugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:22 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Instance destroyed successfully.
Nov 14 18:06:22 user nova-compute[76161]: DEBUG nova.objects.instance [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'resources' on Instance uuid cd162511-a09b-4479-8d29-0a5a4b40ae78 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-431593191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-431593191',id=36,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-630lejpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:04:36Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=cd162511-a09b-4479-8d29-0a5a4b40ae78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "address": "fa:16:3e:be:d3:16", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a82f81-d0", "ovs_interfaceid": "23a82f81-d0bf-420c-a9f9-e8241d7524c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:d3:16,bridge_name='br-int',has_traffic_filtering=True,id=23a82f81-d0bf-420c-a9f9-e8241d7524c5,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a82f81-d0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_vif [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:d3:16,bridge_name='br-int',has_traffic_filtering=True,id=23a82f81-d0bf-420c-a9f9-e8241d7524c5,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a82f81-d0') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23a82f81-d0, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc56e395-3e09-4ccc-85ff-a6822ecb1a5b) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:06:22 user nova-compute[76161]: INFO os_vif [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:d3:16,bridge_name='br-int',has_traffic_filtering=True,id=23a82f81-d0bf-420c-a9f9-e8241d7524c5,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a82f81-d0')
Nov 14 18:06:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHKLVvmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:06:22 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be745e-7387-4261-9a4b-2ce435b6d4ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:06:22 user nova-compute[76161]: No targets found.
Nov 14 18:06:22 user nova-compute[76161]: iSNS:
Nov 14 18:06:22 user nova-compute[76161]: No targets found.
Nov 14 18:06:22 user nova-compute[76161]: STATIC:
Nov 14 18:06:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:06:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:06:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:06:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea
Nov 14 18:06:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:06:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:06:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369
Nov 14 18:06:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:06:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:06:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:06:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:06:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:06:22 user nova-compute[76161]: FIRMWARE:
Nov 14 18:06:22 user nova-compute[76161]: No targets found.
Nov 14 18:06:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:06:22 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:06:22 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b36d10-043f-4e75-9d1c-30799837bc9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa05928-07c6-4a9b-908b-2b26513d751d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:06:22 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:06:22 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:06:22 user nova-compute[76161]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:06:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:06:22 user nova-compute[76161]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 (non-flash)
Nov 14 18:06:22 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:06:22 user nova-compute[76161]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:06:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f014e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[545f6bf1-37e6-42a7-a391-a7d31d6e48de]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[05331395-7da7-45b5-aac4-b24ff434d555]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[057cfb2b-65cd-42a8-ada5-28ea1b71d23a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d448348f-f08d-4742-bf25-cbde1498e2c3]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23664633035326539', '/dev/disk/by-id/scsi-1SCST_BIO18a2ae7d-6dc052e9a8d3e424', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_18a2ae7d') {{(pid=86560) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[90451f77-bbaa-4a9e-94fa-103e714f170d]: (4, None) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece88f50-6ea8-4e45-86da-f9d53f39cdc4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:22 user nova-compute[76161]: INFO nova.compute.manager [None req-263a0973-24d0-4ffa-85a0-e9fdd23d440d tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Get console output
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dc7073-e525-45e0-8387-c12c4642aa96]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369, portal: 172.16.0.220,3260]
Nov 14 18:06:22 user nova-compute[76161]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369, portal: 172.16.0.220,3260] successful.
Nov 14 18:06:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80815466-0bc1-43dd-8a76-979ef49da369 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5670ca7-cc2d-452e-8e4e-b41890c064d4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] <== disconnect_volume: return (339ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:06:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:06:22 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Deleting instance files /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78_del
Nov 14 18:06:22 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Deletion of /opt/stack/data/nova/instances/cd162511-a09b-4479-8d29-0a5a4b40ae78_del complete
Nov 14 18:06:23 user nova-compute[76161]: INFO nova.compute.manager [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 14 18:06:23 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:06:23 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:06:23 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:06:23 user nova-compute[76161]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 18:06:23 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:06:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-dd0e3562-9adc-4d7b-9762-953f1f673881 req-86e4c2bf-dae5-44cb-a590-dff13eada98d service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-deleted-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:23 user nova-compute[76161]: INFO nova.compute.manager [req-dd0e3562-9adc-4d7b-9762-953f1f673881 req-86e4c2bf-dae5-44cb-a590-dff13eada98d service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Neutron deleted interface 23a82f81-d0bf-420c-a9f9-e8241d7524c5; detaching it from the instance and deleting it from the info cache
Nov 14 18:06:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-dd0e3562-9adc-4d7b-9762-953f1f673881 req-86e4c2bf-dae5-44cb-a590-dff13eada98d service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:06:23 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Took 0.43 seconds to deallocate network for instance.
Nov 14 18:06:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-dd0e3562-9adc-4d7b-9762-953f1f673881 req-86e4c2bf-dae5-44cb-a590-dff13eada98d service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Detach interface failed, port_id=23a82f81-d0bf-420c-a9f9-e8241d7524c5, reason: Instance cd162511-a09b-4479-8d29-0a5a4b40ae78 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:06:24 user nova-compute[76161]: INFO nova.compute.manager [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Took 0.83 seconds to detach 1 volumes for instance.
Nov 14 18:06:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-9b2cf363-dbfb-4ae6-8fae-97eaeaa6a2cd req-6c3dd50a-5554-476f-b64e-aa04cbac2736 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9b2cf363-dbfb-4ae6-8fae-97eaeaa6a2cd req-6c3dd50a-5554-476f-b64e-aa04cbac2736 service nova] Acquiring lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9b2cf363-dbfb-4ae6-8fae-97eaeaa6a2cd req-6c3dd50a-5554-476f-b64e-aa04cbac2736 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9b2cf363-dbfb-4ae6-8fae-97eaeaa6a2cd req-6c3dd50a-5554-476f-b64e-aa04cbac2736 service nova] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-9b2cf363-dbfb-4ae6-8fae-97eaeaa6a2cd req-6c3dd50a-5554-476f-b64e-aa04cbac2736 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] No waiting events found dispatching network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:06:24 user nova-compute[76161]: WARNING nova.compute.manager [req-9b2cf363-dbfb-4ae6-8fae-97eaeaa6a2cd req-6c3dd50a-5554-476f-b64e-aa04cbac2736 service nova] [instance: cd162511-a09b-4479-8d29-0a5a4b40ae78] Received unexpected event network-vif-plugged-23a82f81-d0bf-420c-a9f9-e8241d7524c5 for instance with vm_state active and task_state deleting.
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:24 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Deleted allocations for instance cd162511-a09b-4479-8d29-0a5a4b40ae78
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:24 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:06:24 user nova-compute[76161]: INFO nova.compute.claims [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Claim successful on node user
Nov 14 18:06:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-df71e7d8-ad5d-41d6-9ea6-6c9a9e515892 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "cd162511-a09b-4479-8d29-0a5a4b40ae78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.220s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:06:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:06:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG nova.policy [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cee653d6630641b89a074a31d8ddddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e77e9d3740940e6b3c3bbcb66281cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:06:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Creating image(s)
Nov 14 18:06:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "/opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "/opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "/opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk 1073741824" returned: 0 in 0.054s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Successfully created port: 3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Cannot resize image /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Ensure instance console log exists: /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Successfully updated port: 3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquired lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-aa3d4526-60b8-44ae-ba5f-b1fa3ea624fb req-acfa8b38-63a8-4b31-8830-99c77ccc9e6b service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-changed-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-aa3d4526-60b8-44ae-ba5f-b1fa3ea624fb req-acfa8b38-63a8-4b31-8830-99c77ccc9e6b service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Refreshing instance network info cache due to event network-changed-3148c108-daab-4928-8c8c-35ed2c11a9bc. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aa3d4526-60b8-44ae-ba5f-b1fa3ea624fb req-acfa8b38-63a8-4b31-8830-99c77ccc9e6b service nova] Acquiring lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:06:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updating instance_info_cache with network_info: [{"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Releasing lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Instance network_info: |[{"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aa3d4526-60b8-44ae-ba5f-b1fa3ea624fb req-acfa8b38-63a8-4b31-8830-99c77ccc9e6b service nova] Acquired lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-aa3d4526-60b8-44ae-ba5f-b1fa3ea624fb req-acfa8b38-63a8-4b31-8830-99c77ccc9e6b service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Refreshing network info cache for port 3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Start _get_guest_xml network_info=[{"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:06:27 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:06:27 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109152857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109152857',id=40,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2NrH89/xsrXPPHHpfe9xbUselmuX915kYvkiHsNDk/HGgGXPKFEZCO4dEkj3yYeaW8Gko12Y2GSDL2vNeUvyfj7Ova4pX5Y2tpWfReAklnKCXZB0RfvANMe0KAvhs37g==',key_name='tempest-keypair-2021075801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-2okswtgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:06:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=30f22af1-c024-4da6-bf55-7fba565bd50b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.objects.instance [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'pci_devices' on Instance uuid 30f22af1-c024-4da6-bf55-7fba565bd50b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:06:27 user nova-compute[76161]:   <uuid>30f22af1-c024-4da6-bf55-7fba565bd50b</uuid>
Nov 14 18:06:27 user nova-compute[76161]:   <name>instance-00000028</name>
Nov 14 18:06:27 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:06:27 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:06:27 user nova-compute[76161]:   <metadata>
Nov 14 18:06:27 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:06:27 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:06:27 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1109152857</nova:name>
Nov 14 18:06:27 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:06:27</nova:creationTime>
Nov 14 18:06:27 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:06:27 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:06:27 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:06:27 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:06:27 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:06:27 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:06:27 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:06:27 user nova-compute[76161]:       <nova:owner>
Nov 14 18:06:27 user nova-compute[76161]:         <nova:user uuid="cee653d6630641b89a074a31d8ddddbc">tempest-AttachVolumeShelveTestJSON-1624203066-project-member</nova:user>
Nov 14 18:06:27 user nova-compute[76161]:         <nova:project uuid="3e77e9d3740940e6b3c3bbcb66281cdd">tempest-AttachVolumeShelveTestJSON-1624203066</nova:project>
Nov 14 18:06:27 user nova-compute[76161]:       </nova:owner>
Nov 14 18:06:27 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:06:27 user nova-compute[76161]:       <nova:ports>
Nov 14 18:06:27 user nova-compute[76161]:         <nova:port uuid="3148c108-daab-4928-8c8c-35ed2c11a9bc">
Nov 14 18:06:27 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 18:06:27 user nova-compute[76161]:         </nova:port>
Nov 14 18:06:27 user nova-compute[76161]:       </nova:ports>
Nov 14 18:06:27 user nova-compute[76161]:     </nova:instance>
Nov 14 18:06:27 user nova-compute[76161]:   </metadata>
Nov 14 18:06:27 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:06:27 user nova-compute[76161]:     <system>
Nov 14 18:06:27 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:06:27 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:06:27 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:06:27 user nova-compute[76161]:       <entry name="serial">30f22af1-c024-4da6-bf55-7fba565bd50b</entry>
Nov 14 18:06:27 user nova-compute[76161]:       <entry name="uuid">30f22af1-c024-4da6-bf55-7fba565bd50b</entry>
Nov 14 18:06:27 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:06:27 user nova-compute[76161]:     </system>
Nov 14 18:06:27 user nova-compute[76161]:   </sysinfo>
Nov 14 18:06:27 user nova-compute[76161]:   <os>
Nov 14 18:06:27 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:06:27 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:06:27 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:06:27 user nova-compute[76161]:   </os>
Nov 14 18:06:27 user nova-compute[76161]:   <features>
Nov 14 18:06:27 user nova-compute[76161]:     <acpi/>
Nov 14 18:06:27 user nova-compute[76161]:     <apic/>
Nov 14 18:06:27 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:06:27 user nova-compute[76161]:   </features>
Nov 14 18:06:27 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:06:27 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:06:27 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:06:27 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:06:27 user nova-compute[76161]:   </clock>
Nov 14 18:06:27 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:06:27 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:06:27 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:06:27 user nova-compute[76161]:   </cpu>
Nov 14 18:06:27 user nova-compute[76161]:   <devices>
Nov 14 18:06:27 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:06:27 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:06:27 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk"/>
Nov 14 18:06:27 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:06:27 user nova-compute[76161]:     </disk>
Nov 14 18:06:27 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:06:27 user nova-compute[76161]:       <mac address="fa:16:3e:d6:60:96"/>
Nov 14 18:06:27 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:06:27 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:06:27 user nova-compute[76161]:       <target dev="tap3148c108-da"/>
Nov 14 18:06:27 user nova-compute[76161]:     </interface>
Nov 14 18:06:27 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:06:27 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/console.log" append="off"/>
Nov 14 18:06:27 user nova-compute[76161]:     </serial>
Nov 14 18:06:27 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:06:27 user nova-compute[76161]:     <video>
Nov 14 18:06:27 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:06:27 user nova-compute[76161]:     </video>
Nov 14 18:06:27 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:06:27 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:06:27 user nova-compute[76161]:     </rng>
Nov 14 18:06:27 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:06:27 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:06:27 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:06:27 user nova-compute[76161]:     </memballoon>
Nov 14 18:06:27 user nova-compute[76161]:   </devices>
Nov 14 18:06:27 user nova-compute[76161]: </domain>
Nov 14 18:06:27 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109152857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109152857',id=40,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2NrH89/xsrXPPHHpfe9xbUselmuX915kYvkiHsNDk/HGgGXPKFEZCO4dEkj3yYeaW8Gko12Y2GSDL2vNeUvyfj7Ova4pX5Y2tpWfReAklnKCXZB0RfvANMe0KAvhs37g==',key_name='tempest-keypair-2021075801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-2okswtgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:06:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=30f22af1-c024-4da6-bf55-7fba565bd50b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG os_vif [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee857c3d-d7bd-5f12-944d-b27ef20e53f8', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3148c108-da, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3148c108-da, col_values=(('qos', UUID('f2bfa4b0-59c8-498a-a375-809adf52b0f2')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3148c108-da, col_values=(('external_ids', {'iface-id': '3148c108-daab-4928-8c8c-35ed2c11a9bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:60:96', 'vm-uuid': '30f22af1-c024-4da6-bf55-7fba565bd50b'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:27 user nova-compute[76161]: INFO os_vif [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da')
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] No VIF found with MAC fa:16:3e:d6:60:96, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-aa3d4526-60b8-44ae-ba5f-b1fa3ea624fb req-acfa8b38-63a8-4b31-8830-99c77ccc9e6b service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updated VIF entry in instance network info cache for port 3148c108-daab-4928-8c8c-35ed2c11a9bc. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-aa3d4526-60b8-44ae-ba5f-b1fa3ea624fb req-acfa8b38-63a8-4b31-8830-99c77ccc9e6b service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updating instance_info_cache with network_info: [{"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aa3d4526-60b8-44ae-ba5f-b1fa3ea624fb req-acfa8b38-63a8-4b31-8830-99c77ccc9e6b service nova] Releasing lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-3e0c1ee8-4ccc-4c89-990e-14cc8214ca60 req-7993b7db-fa2a-48da-9341-0c1f466aeeb4 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3e0c1ee8-4ccc-4c89-990e-14cc8214ca60 req-7993b7db-fa2a-48da-9341-0c1f466aeeb4 service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3e0c1ee8-4ccc-4c89-990e-14cc8214ca60 req-7993b7db-fa2a-48da-9341-0c1f466aeeb4 service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3e0c1ee8-4ccc-4c89-990e-14cc8214ca60 req-7993b7db-fa2a-48da-9341-0c1f466aeeb4 service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-3e0c1ee8-4ccc-4c89-990e-14cc8214ca60 req-7993b7db-fa2a-48da-9341-0c1f466aeeb4 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:06:29 user nova-compute[76161]: WARNING nova.compute.manager [req-3e0c1ee8-4ccc-4c89-990e-14cc8214ca60 req-7993b7db-fa2a-48da-9341-0c1f466aeeb4 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state building and task_state spawning.
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:06:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:06:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:06:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Instance spawned successfully.
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:06:31 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:06:31 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7621MB free_disk=24.9735107421875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-d664891f-331f-4b30-b29b-f215f0e39721 req-93fcfd28-dee6-449f-9752-5f3c1c9dc5ea service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d664891f-331f-4b30-b29b-f215f0e39721 req-93fcfd28-dee6-449f-9752-5f3c1c9dc5ea service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d664891f-331f-4b30-b29b-f215f0e39721 req-93fcfd28-dee6-449f-9752-5f3c1c9dc5ea service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d664891f-331f-4b30-b29b-f215f0e39721 req-93fcfd28-dee6-449f-9752-5f3c1c9dc5ea service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-d664891f-331f-4b30-b29b-f215f0e39721 req-93fcfd28-dee6-449f-9752-5f3c1c9dc5ea service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:06:31 user nova-compute[76161]: WARNING nova.compute.manager [req-d664891f-331f-4b30-b29b-f215f0e39721 req-93fcfd28-dee6-449f-9752-5f3c1c9dc5ea service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state building and task_state spawning.
Nov 14 18:06:31 user nova-compute[76161]: INFO nova.compute.manager [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 75295499-8f99-4c9b-a556-c1287c61d8f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 385ef873-fc1f-46ae-90da-b75f82524b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0a5d3ce-4564-434d-9650-36548fb33ab0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0ec5fe2-517b-498c-8606-9417432c8803 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 30f22af1-c024-4da6-bf55-7fba565bd50b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:06:31 user nova-compute[76161]: INFO nova.compute.manager [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Took 6.31 seconds to build instance.
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4561c422-1c34-470f-a224-e5f6b84eef58 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.427s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:31 user nova-compute[76161]: INFO nova.compute.manager [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Terminating instance
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-2cf33a3e-d398-4343-9c36-3e55cf2e124b req-c28848b4-6f98-4933-af10-731ecf0e0ec1 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received event network-vif-unplugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2cf33a3e-d398-4343-9c36-3e55cf2e124b req-c28848b4-6f98-4933-af10-731ecf0e0ec1 service nova] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2cf33a3e-d398-4343-9c36-3e55cf2e124b req-c28848b4-6f98-4933-af10-731ecf0e0ec1 service nova] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-2cf33a3e-d398-4343-9c36-3e55cf2e124b req-c28848b4-6f98-4933-af10-731ecf0e0ec1 service nova] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-2cf33a3e-d398-4343-9c36-3e55cf2e124b req-c28848b4-6f98-4933-af10-731ecf0e0ec1 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] No waiting events found dispatching network-vif-unplugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:06:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-2cf33a3e-d398-4343-9c36-3e55cf2e124b req-c28848b4-6f98-4933-af10-731ecf0e0ec1 service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received event network-vif-unplugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:06:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Instance destroyed successfully.
Nov 14 18:06:32 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lazy-loading 'resources' on Instance uuid 236486e6-e33d-4027-a91e-dd2c6cb20ce7 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-972451438',display_name='tempest-AttachVolumeNegativeTest-server-972451438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-972451438',id=38,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqn45symUWCucAAgdZuPkUZb4h1A0qpALvO2TV/mFJs5/2aKNDquNCnM85pbMPX/BmqaAKX3+ZUUuHANJ21TQ3ICT0rnkCI4yXmyO704M4vZupDa9SO+eQI6vtPj4fRUg==',key_name='tempest-keypair-430670252',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:03:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45eab8e344af47a2b1b28fa471a4acc3',ramdisk_id='',reservation_id='r-u6yxya07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-453609882',owner_user_name='tempest-AttachVolumeNegativeTest-453609882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49edd5581ca44780ac590c2b072b338d',uuid=236486e6-e33d-4027-a91e-dd2c6cb20ce7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converting VIF {"id": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "address": "fa:16:3e:e2:0f:f4", "network": {"id": "3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1197400878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45eab8e344af47a2b1b28fa471a4acc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1e8d73-f8", "ovs_interfaceid": "9c1e8d73-f859-469b-9e3d-3be83cbbe22c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0f:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c1e8d73-f859-469b-9e3d-3be83cbbe22c,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1e8d73-f8') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG os_vif [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0f:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c1e8d73-f859-469b-9e3d-3be83cbbe22c,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1e8d73-f8') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c1e8d73-f8, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=145d2827-6078-4a23-8668-f910d9d35bbd) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:06:32 user nova-compute[76161]: INFO os_vif [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0f:f4,bridge_name='br-int',has_traffic_filtering=True,id=9c1e8d73-f859-469b-9e3d-3be83cbbe22c,network=Network(3a8c22fc-1e4c-4816-a6fc-6fc6658cc0a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1e8d73-f8')
Nov 14 18:06:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Deleting instance files /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7_del
Nov 14 18:06:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Deletion of /opt/stack/data/nova/instances/236486e6-e33d-4027-a91e-dd2c6cb20ce7_del complete
Nov 14 18:06:32 user nova-compute[76161]: INFO nova.compute.manager [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 18:06:32 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:06:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:06:33 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Took 0.67 seconds to deallocate network for instance.
Nov 14 18:06:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-7cf9c53b-bbfe-4a17-a36c-73458c4064f5 req-bf46127a-513e-4c38-b391-74908fc58fbe service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received event network-vif-deleted-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:33 user nova-compute[76161]: INFO nova.compute.manager [req-7cf9c53b-bbfe-4a17-a36c-73458c4064f5 req-bf46127a-513e-4c38-b391-74908fc58fbe service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Neutron deleted interface 9c1e8d73-f859-469b-9e3d-3be83cbbe22c; detaching it from the instance and deleting it from the info cache
Nov 14 18:06:33 user nova-compute[76161]: DEBUG nova.network.neutron [req-7cf9c53b-bbfe-4a17-a36c-73458c4064f5 req-bf46127a-513e-4c38-b391-74908fc58fbe service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-7cf9c53b-bbfe-4a17-a36c-73458c4064f5 req-bf46127a-513e-4c38-b391-74908fc58fbe service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Detach interface failed, port_id=9c1e8d73-f859-469b-9e3d-3be83cbbe22c, reason: Instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:33 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Deleted allocations for instance 236486e6-e33d-4027-a91e-dd2c6cb20ce7
Nov 14 18:06:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0ae81421-3b3a-453b-bcf6-238bb4650aa1 tempest-AttachVolumeNegativeTest-453609882 tempest-AttachVolumeNegativeTest-453609882-project-member] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.082s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-836bb8c8-6ae3-41f9-83ed-4c877b877281 req-abb072d4-7ffb-4e7b-ba1b-e7151ca7a25a service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received event network-vif-plugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-836bb8c8-6ae3-41f9-83ed-4c877b877281 req-abb072d4-7ffb-4e7b-ba1b-e7151ca7a25a service nova] Acquiring lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-836bb8c8-6ae3-41f9-83ed-4c877b877281 req-abb072d4-7ffb-4e7b-ba1b-e7151ca7a25a service nova] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-836bb8c8-6ae3-41f9-83ed-4c877b877281 req-abb072d4-7ffb-4e7b-ba1b-e7151ca7a25a service nova] Lock "236486e6-e33d-4027-a91e-dd2c6cb20ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-836bb8c8-6ae3-41f9-83ed-4c877b877281 req-abb072d4-7ffb-4e7b-ba1b-e7151ca7a25a service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] No waiting events found dispatching network-vif-plugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:06:33 user nova-compute[76161]: WARNING nova.compute.manager [req-836bb8c8-6ae3-41f9-83ed-4c877b877281 req-abb072d4-7ffb-4e7b-ba1b-e7151ca7a25a service nova] [instance: 236486e6-e33d-4027-a91e-dd2c6cb20ce7] Received unexpected event network-vif-plugged-9c1e8d73-f859-469b-9e3d-3be83cbbe22c for instance with vm_state deleted and task_state None.
Nov 14 18:06:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:57 user nova-compute[76161]: INFO nova.compute.manager [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Terminating instance
Nov 14 18:06:57 user nova-compute[76161]: DEBUG nova.compute.manager [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-ec32b7ce-bebe-4821-b8a8-c902f75559ae req-bca08688-bc38-4b5a-9ac8-863bd34e6542 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ec32b7ce-bebe-4821-b8a8-c902f75559ae req-bca08688-bc38-4b5a-9ac8-863bd34e6542 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ec32b7ce-bebe-4821-b8a8-c902f75559ae req-bca08688-bc38-4b5a-9ac8-863bd34e6542 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ec32b7ce-bebe-4821-b8a8-c902f75559ae req-bca08688-bc38-4b5a-9ac8-863bd34e6542 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-ec32b7ce-bebe-4821-b8a8-c902f75559ae req-bca08688-bc38-4b5a-9ac8-863bd34e6542 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-ec32b7ce-bebe-4821-b8a8-c902f75559ae req-bca08688-bc38-4b5a-9ac8-863bd34e6542 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-unplugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:06:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Instance destroyed successfully.
Nov 14 18:06:58 user nova-compute[76161]: DEBUG nova.objects.instance [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'resources' on Instance uuid 75295499-8f99-4c9b-a556-c1287c61d8f2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1792224443',display_name='tempest-AttachVolumeTestJSON-server-1792224443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1792224443',id=24,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwTHCRRw1KxJLD9CcCs2gIwosvX+o4FaLgfSFYOuEANvq2aIipEcsGq1NHxa+NHKqWzzuxELOvKadsYZSKZeiQ7BOeCDXZ3VUvf4hvZmX1n4PdafIxgOfEgrSs9aoeq3Q==',key_name='tempest-keypair-1778122280',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-iw0i0sws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=75295499-8f99-4c9b-a556-c1287c61d8f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "address": "fa:16:3e:38:ed:cd", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c3c5f8-f7", "ovs_interfaceid": "d9c3c5f8-f77b-4475-9693-c63f6e310d19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG os_vif [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9c3c5f8-f7, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ce0013d-c2d7-4b26-9efa-5c2aedf380b9) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:06:58 user nova-compute[76161]: INFO os_vif [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:ed:cd,bridge_name='br-int',has_traffic_filtering=True,id=d9c3c5f8-f77b-4475-9693-c63f6e310d19,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c3c5f8-f7')
Nov 14 18:06:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Deleting instance files /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2_del
Nov 14 18:06:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Deletion of /opt/stack/data/nova/instances/75295499-8f99-4c9b-a556-c1287c61d8f2_del complete
Nov 14 18:06:58 user nova-compute[76161]: INFO nova.compute.manager [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 18:06:58 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:06:58 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:06:59 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:06:59 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Took 0.66 seconds to deallocate network for instance.
Nov 14 18:06:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:06:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:06:59 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:06:59 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:06:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:06:59 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Deleted allocations for instance 75295499-8f99-4c9b-a556-c1287c61d8f2
Nov 14 18:06:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-28996c34-de0a-4f37-bb90-458c864bfe83 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-ecfb7f5d-08ad-4382-aa58-eadd00ecf401 req-213e01a5-70a3-450c-a299-81ea78e23b18 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ecfb7f5d-08ad-4382-aa58-eadd00ecf401 req-213e01a5-70a3-450c-a299-81ea78e23b18 service nova] Acquiring lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ecfb7f5d-08ad-4382-aa58-eadd00ecf401 req-213e01a5-70a3-450c-a299-81ea78e23b18 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ecfb7f5d-08ad-4382-aa58-eadd00ecf401 req-213e01a5-70a3-450c-a299-81ea78e23b18 service nova] Lock "75295499-8f99-4c9b-a556-c1287c61d8f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-ecfb7f5d-08ad-4382-aa58-eadd00ecf401 req-213e01a5-70a3-450c-a299-81ea78e23b18 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] No waiting events found dispatching network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:07:00 user nova-compute[76161]: WARNING nova.compute.manager [req-ecfb7f5d-08ad-4382-aa58-eadd00ecf401 req-213e01a5-70a3-450c-a299-81ea78e23b18 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received unexpected event network-vif-plugged-d9c3c5f8-f77b-4475-9693-c63f6e310d19 for instance with vm_state deleted and task_state None.
Nov 14 18:07:00 user nova-compute[76161]: DEBUG nova.compute.manager [req-ecfb7f5d-08ad-4382-aa58-eadd00ecf401 req-213e01a5-70a3-450c-a299-81ea78e23b18 service nova] [instance: 75295499-8f99-4c9b-a556-c1287c61d8f2] Received event network-vif-deleted-d9c3c5f8-f77b-4475-9693-c63f6e310d19 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "385ef873-fc1f-46ae-90da-b75f82524b99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "385ef873-fc1f-46ae-90da-b75f82524b99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:12 user nova-compute[76161]: INFO nova.compute.manager [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Terminating instance
Nov 14 18:07:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:07:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-b34c7eeb-c15f-47cd-ad43-dacdad5fb131 req-fbbd6a54-942a-49a6-872b-2651fb478065 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Received event network-vif-unplugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b34c7eeb-c15f-47cd-ad43-dacdad5fb131 req-fbbd6a54-942a-49a6-872b-2651fb478065 service nova] Acquiring lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b34c7eeb-c15f-47cd-ad43-dacdad5fb131 req-fbbd6a54-942a-49a6-872b-2651fb478065 service nova] Lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b34c7eeb-c15f-47cd-ad43-dacdad5fb131 req-fbbd6a54-942a-49a6-872b-2651fb478065 service nova] Lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-b34c7eeb-c15f-47cd-ad43-dacdad5fb131 req-fbbd6a54-942a-49a6-872b-2651fb478065 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] No waiting events found dispatching network-vif-unplugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-b34c7eeb-c15f-47cd-ad43-dacdad5fb131 req-fbbd6a54-942a-49a6-872b-2651fb478065 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Received event network-vif-unplugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Instance destroyed successfully.
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.objects.instance [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'resources' on Instance uuid 385ef873-fc1f-46ae-90da-b75f82524b99 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2119915686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2119915686',id=28,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:57:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-27wx0uw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:59:46Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=385ef873-fc1f-46ae-90da-b75f82524b99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "address": "fa:16:3e:b4:85:5b", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50dbbfa6-c6", "ovs_interfaceid": "50dbbfa6-c6cd-400f-947c-4b0036b6bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:85:5b,bridge_name='br-int',has_traffic_filtering=True,id=50dbbfa6-c6cd-400f-947c-4b0036b6bc22,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dbbfa6-c6') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG os_vif [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:85:5b,bridge_name='br-int',has_traffic_filtering=True,id=50dbbfa6-c6cd-400f-947c-4b0036b6bc22,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dbbfa6-c6') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50dbbfa6-c6, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49c80498-6c54-469c-a994-54e9a5d40563) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:13 user nova-compute[76161]: INFO os_vif [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:85:5b,bridge_name='br-int',has_traffic_filtering=True,id=50dbbfa6-c6cd-400f-947c-4b0036b6bc22,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50dbbfa6-c6')
Nov 14 18:07:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Deleting instance files /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99_del
Nov 14 18:07:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Deletion of /opt/stack/data/nova/instances/385ef873-fc1f-46ae-90da-b75f82524b99_del complete
Nov 14 18:07:13 user nova-compute[76161]: INFO nova.compute.manager [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 18:07:13 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:07:13 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Took 0.37 seconds to deallocate network for instance.
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-ed6667f7-2855-456f-900e-fd76f8a46b0f req-0644a1cb-4e50-4216-89cd-e67cddeb8d32 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Received event network-vif-deleted-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:13 user nova-compute[76161]: INFO nova.compute.manager [req-ed6667f7-2855-456f-900e-fd76f8a46b0f req-0644a1cb-4e50-4216-89cd-e67cddeb8d32 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Neutron deleted interface 50dbbfa6-c6cd-400f-947c-4b0036b6bc22; detaching it from the instance and deleting it from the info cache
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.network.neutron [req-ed6667f7-2855-456f-900e-fd76f8a46b0f req-0644a1cb-4e50-4216-89cd-e67cddeb8d32 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-ed6667f7-2855-456f-900e-fd76f8a46b0f req-0644a1cb-4e50-4216-89cd-e67cddeb8d32 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Detach interface failed, port_id=50dbbfa6-c6cd-400f-947c-4b0036b6bc22, reason: Instance 385ef873-fc1f-46ae-90da-b75f82524b99 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:14 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:07:14 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:07:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:14 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Deleted allocations for instance 385ef873-fc1f-46ae-90da-b75f82524b99
Nov 14 18:07:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92088613-56dd-438d-944d-548bce0ebb17 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "385ef873-fc1f-46ae-90da-b75f82524b99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.736s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-a755e3c7-4a38-4e9c-978a-be2887815e7a req-39f06bbd-7621-4184-8e8b-cb7635bdab48 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Received event network-vif-plugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a755e3c7-4a38-4e9c-978a-be2887815e7a req-39f06bbd-7621-4184-8e8b-cb7635bdab48 service nova] Acquiring lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a755e3c7-4a38-4e9c-978a-be2887815e7a req-39f06bbd-7621-4184-8e8b-cb7635bdab48 service nova] Lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a755e3c7-4a38-4e9c-978a-be2887815e7a req-39f06bbd-7621-4184-8e8b-cb7635bdab48 service nova] Lock "385ef873-fc1f-46ae-90da-b75f82524b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-a755e3c7-4a38-4e9c-978a-be2887815e7a req-39f06bbd-7621-4184-8e8b-cb7635bdab48 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] No waiting events found dispatching network-vif-plugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:07:15 user nova-compute[76161]: WARNING nova.compute.manager [req-a755e3c7-4a38-4e9c-978a-be2887815e7a req-39f06bbd-7621-4184-8e8b-cb7635bdab48 service nova] [instance: 385ef873-fc1f-46ae-90da-b75f82524b99] Received unexpected event network-vif-plugged-50dbbfa6-c6cd-400f-947c-4b0036b6bc22 for instance with vm_state deleted and task_state None.
Nov 14 18:07:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:20 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:07:22 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:23 user nova-compute[76161]: INFO nova.compute.manager [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Terminating instance
Nov 14 18:07:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updating instance_info_cache with network_info: [{"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-fdfc3c0a-4122-4d46-a50b-244cdc0efcac req-ea305d4b-1e6a-4b86-b6b9-1934efa3c1cd service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-vif-unplugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fdfc3c0a-4122-4d46-a50b-244cdc0efcac req-ea305d4b-1e6a-4b86-b6b9-1934efa3c1cd service nova] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fdfc3c0a-4122-4d46-a50b-244cdc0efcac req-ea305d4b-1e6a-4b86-b6b9-1934efa3c1cd service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fdfc3c0a-4122-4d46-a50b-244cdc0efcac req-ea305d4b-1e6a-4b86-b6b9-1934efa3c1cd service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-fdfc3c0a-4122-4d46-a50b-244cdc0efcac req-ea305d4b-1e6a-4b86-b6b9-1934efa3c1cd service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] No waiting events found dispatching network-vif-unplugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-fdfc3c0a-4122-4d46-a50b-244cdc0efcac req-ea305d4b-1e6a-4b86-b6b9-1934efa3c1cd service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-vif-unplugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:07:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Instance destroyed successfully.
Nov 14 18:07:24 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'resources' on Instance uuid a0a5d3ce-4564-434d-9650-36548fb33ab0 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-927479785',display_name='tempest-ServerActionsTestOtherA-server-927479785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-927479785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/qLMrSixUeoWRNqyyMAmkr6Jdv4puUPBA23tnedByCcFoj2iOZE+ZPEXsuKk/6jLGW1AaCT9PLvxK/WjfaizeZDXI/isTmP1fIOMxcZKPA16ZEa+3fb0iod0Nl+OKmuw==',key_name='tempest-keypair-197899952',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:03:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-8sb5sxna',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=a0a5d3ce-4564-434d-9650-36548fb33ab0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "address": "fa:16:3e:4a:e7:94", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d4380d-a5", "ovs_interfaceid": "a4d4380d-a5c8-4a18-8255-7e256cc7c3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_vif [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4d4380d-a5, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f51fd394-bdd3-4a0c-843d-dae3a58ab536) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:07:24 user nova-compute[76161]: INFO os_vif [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:e7:94,bridge_name='br-int',has_traffic_filtering=True,id=a4d4380d-a5c8-4a18-8255-7e256cc7c3f1,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d4380d-a5')
Nov 14 18:07:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rmKOogtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:07:24 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7985315f-8af8-4c98-b41c-5360ddfda4b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:07:24 user nova-compute[76161]: No targets found.
Nov 14 18:07:24 user nova-compute[76161]: iSNS:
Nov 14 18:07:24 user nova-compute[76161]: No targets found.
Nov 14 18:07:24 user nova-compute[76161]: STATIC:
Nov 14 18:07:24 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:07:24 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:07:24 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:07:24 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea
Nov 14 18:07:24 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:07:24 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:07:24 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe
Nov 14 18:07:24 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:07:24 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:07:24 user nova-compute[76161]: FIRMWARE:
Nov 14 18:07:24 user nova-compute[76161]: No targets found.
Nov 14 18:07:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:07:24 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:07:24 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f560112-7bd2-4612-8cab-b43816897450]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de61444-296f-4eef-b443-2904255c94b6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:07:24 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:07:24 user nova-compute[76161]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:07:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:07:24 user nova-compute[76161]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe (non-flash)
Nov 14 18:07:24 user nova-compute[76161]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:07:24 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f06e1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe'): ({'sdf'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Removing single pathed devices sdf {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7123f351-4c4e-4851-b25c-62e761ce5272]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ffd00c-be83-435e-a222-cff8f3ec80bc]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Flushing IO for device /dev/sdf {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdf5f69-5827-45ce-b158-077a55277291]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df6997-495d-4f80-87c9-1e5a7cc6f9f0]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] SCSI volumes sdf have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO46a47aa5-544a3b2832f3fe03', '/dev/disk/by-id/scsi-23534346133623238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_46a47aa5') {{(pid=86560) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b6d2b4-64ec-4b62-9eec-25eca358834b]: (4, None) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1010282-65bc-40a8-a810-f9d96a779c0b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:07:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9ba066-b4c8-422a-9652-5bdba7bd02d7]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260]
Nov 14 18:07:25 user nova-compute[76161]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe, portal: 172.16.0.220,3260] successful.
Nov 14 18:07:25 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6101ad26-b308-4342-b713-180af5bf40fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aae597c-0c6d-4aa2-b9aa-d803aa0e0fc3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] <== disconnect_volume: return (384ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:07:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Deleting instance files /opt/stack/data/nova/instances/a0a5d3ce-4564-434d-9650-36548fb33ab0_del
Nov 14 18:07:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Deletion of /opt/stack/data/nova/instances/a0a5d3ce-4564-434d-9650-36548fb33ab0_del complete
Nov 14 18:07:25 user nova-compute[76161]: INFO nova.compute.manager [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 14 18:07:25 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:07:25 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:07:25 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Took 0.70 seconds to deallocate network for instance.
Nov 14 18:07:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-c04407ca-b35d-4e6b-9b0d-2b4ce5fee772 req-f9eb0f5b-5aec-491e-8d24-5739e9e6d4a7 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-vif-deleted-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-4fbb9575-32cd-4c1d-8004-41c03022d48f req-de1849af-91ad-4ab5-ae3a-b090e78dd5a3 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4fbb9575-32cd-4c1d-8004-41c03022d48f req-de1849af-91ad-4ab5-ae3a-b090e78dd5a3 service nova] Acquiring lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4fbb9575-32cd-4c1d-8004-41c03022d48f req-de1849af-91ad-4ab5-ae3a-b090e78dd5a3 service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4fbb9575-32cd-4c1d-8004-41c03022d48f req-de1849af-91ad-4ab5-ae3a-b090e78dd5a3 service nova] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-4fbb9575-32cd-4c1d-8004-41c03022d48f req-de1849af-91ad-4ab5-ae3a-b090e78dd5a3 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] No waiting events found dispatching network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:07:26 user nova-compute[76161]: WARNING nova.compute.manager [req-4fbb9575-32cd-4c1d-8004-41c03022d48f req-de1849af-91ad-4ab5-ae3a-b090e78dd5a3 service nova] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Received unexpected event network-vif-plugged-a4d4380d-a5c8-4a18-8255-7e256cc7c3f1 for instance with vm_state active and task_state deleting.
Nov 14 18:07:26 user nova-compute[76161]: INFO nova.compute.manager [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 18:07:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: a0a5d3ce-4564-434d-9650-36548fb33ab0] Deleting volume: 6101ad26-b308-4342-b713-180af5bf40fe {{(pid=76161) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:27 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:07:27 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:07:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:27 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Deleted allocations for instance a0a5d3ce-4564-434d-9650-36548fb33ab0
Nov 14 18:07:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0490ea19-1997-4b9a-917b-bc8a1ed881f8 tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "a0a5d3ce-4564-434d-9650-36548fb33ab0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.461s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:31 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:07:31 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8036MB free_disk=25.12476348876953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 1040ce71-437b-4398-9bb5-bd34e86589a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e6b27e32-d956-4f41-b278-d7d088c7edbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0ec5fe2-517b-498c-8606-9417432c8803 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 30f22af1-c024-4da6-bf55-7fba565bd50b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:07:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:07:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:07:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:32 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:07:32 user nova-compute[76161]: INFO nova.compute.claims [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Claim successful on node user
Nov 14 18:07:33 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:07:33 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:07:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG nova.policy [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd463f3fddeba4976bded6ba5abc6c98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '952a823fe4e04963916979f78d5c82a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:07:33 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Creating image(s)
Nov 14 18:07:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.199s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk 1073741824" returned: 0 in 0.053s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.205s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Successfully created port: 5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Cannot resize image /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Ensure instance console log exists: /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Successfully updated port: 5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquired lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-44637c2c-3796-44dc-b1ea-0959a40747e2 req-c0edc300-a1d3-49f6-831b-1cb2aad54dcd service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-changed-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-44637c2c-3796-44dc-b1ea-0959a40747e2 req-c0edc300-a1d3-49f6-831b-1cb2aad54dcd service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Refreshing instance network info cache due to event network-changed-5296e396-4864-4119-a35b-bc4eb12284c1. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:07:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-44637c2c-3796-44dc-b1ea-0959a40747e2 req-c0edc300-a1d3-49f6-831b-1cb2aad54dcd service nova] Acquiring lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.network.neutron [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updating instance_info_cache with network_info: [{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Releasing lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Instance network_info: |[{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-44637c2c-3796-44dc-b1ea-0959a40747e2 req-c0edc300-a1d3-49f6-831b-1cb2aad54dcd service nova] Acquired lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.network.neutron [req-44637c2c-3796-44dc-b1ea-0959a40747e2 req-c0edc300-a1d3-49f6-831b-1cb2aad54dcd service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Refreshing network info cache for port 5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Start _get_guest_xml network_info=[{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:07:35 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:07:35 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1076990849',display_name='tempest-ServerRescueNegativeTestJSON-server-1076990849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1076990849',id=41,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBeZoRV3kMXn/GA46eMNNcJ0tRZceNHh7TAIS5rF1neUcM4S6sNuRCXF0QtpQeXfc7hMCS+WkohSV8NcLF0hT2hw1cucJ9T0krp596vdpHjZgIxTbNUVRRJKYsl61TLWA==',key_name='tempest-keypair-719486534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-puohjd9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=e4f6135c-879b-4a15-8798-b6d83e5823da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:8a:b9,bridge_name='br-int',has_traffic_filtering=True,id=5296e396-4864-4119-a35b-bc4eb12284c1,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296e396-48') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.objects.instance [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'pci_devices' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:07:35 user nova-compute[76161]:   <uuid>e4f6135c-879b-4a15-8798-b6d83e5823da</uuid>
Nov 14 18:07:35 user nova-compute[76161]:   <name>instance-00000029</name>
Nov 14 18:07:35 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:07:35 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:07:35 user nova-compute[76161]:   <metadata>
Nov 14 18:07:35 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:07:35 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:07:35 user nova-compute[76161]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1076990849</nova:name>
Nov 14 18:07:35 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:07:35</nova:creationTime>
Nov 14 18:07:35 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:07:35 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:07:35 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:07:35 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:07:35 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:07:35 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:07:35 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:07:35 user nova-compute[76161]:       <nova:owner>
Nov 14 18:07:35 user nova-compute[76161]:         <nova:user uuid="d463f3fddeba4976bded6ba5abc6c98c">tempest-ServerRescueNegativeTestJSON-1787067728-project-member</nova:user>
Nov 14 18:07:35 user nova-compute[76161]:         <nova:project uuid="952a823fe4e04963916979f78d5c82a7">tempest-ServerRescueNegativeTestJSON-1787067728</nova:project>
Nov 14 18:07:35 user nova-compute[76161]:       </nova:owner>
Nov 14 18:07:35 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:07:35 user nova-compute[76161]:       <nova:ports>
Nov 14 18:07:35 user nova-compute[76161]:         <nova:port uuid="5296e396-4864-4119-a35b-bc4eb12284c1">
Nov 14 18:07:35 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 18:07:35 user nova-compute[76161]:         </nova:port>
Nov 14 18:07:35 user nova-compute[76161]:       </nova:ports>
Nov 14 18:07:35 user nova-compute[76161]:     </nova:instance>
Nov 14 18:07:35 user nova-compute[76161]:   </metadata>
Nov 14 18:07:35 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:07:35 user nova-compute[76161]:     <system>
Nov 14 18:07:35 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:07:35 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:07:35 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:07:35 user nova-compute[76161]:       <entry name="serial">e4f6135c-879b-4a15-8798-b6d83e5823da</entry>
Nov 14 18:07:35 user nova-compute[76161]:       <entry name="uuid">e4f6135c-879b-4a15-8798-b6d83e5823da</entry>
Nov 14 18:07:35 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:07:35 user nova-compute[76161]:     </system>
Nov 14 18:07:35 user nova-compute[76161]:   </sysinfo>
Nov 14 18:07:35 user nova-compute[76161]:   <os>
Nov 14 18:07:35 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:07:35 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:07:35 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:07:35 user nova-compute[76161]:   </os>
Nov 14 18:07:35 user nova-compute[76161]:   <features>
Nov 14 18:07:35 user nova-compute[76161]:     <acpi/>
Nov 14 18:07:35 user nova-compute[76161]:     <apic/>
Nov 14 18:07:35 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:07:35 user nova-compute[76161]:   </features>
Nov 14 18:07:35 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:07:35 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:07:35 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:07:35 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:07:35 user nova-compute[76161]:   </clock>
Nov 14 18:07:35 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:07:35 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:07:35 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:07:35 user nova-compute[76161]:   </cpu>
Nov 14 18:07:35 user nova-compute[76161]:   <devices>
Nov 14 18:07:35 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:07:35 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:07:35 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk"/>
Nov 14 18:07:35 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:07:35 user nova-compute[76161]:     </disk>
Nov 14 18:07:35 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:07:35 user nova-compute[76161]:       <mac address="fa:16:3e:38:8a:b9"/>
Nov 14 18:07:35 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:07:35 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:07:35 user nova-compute[76161]:       <target dev="tap5296e396-48"/>
Nov 14 18:07:35 user nova-compute[76161]:     </interface>
Nov 14 18:07:35 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:07:35 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/console.log" append="off"/>
Nov 14 18:07:35 user nova-compute[76161]:     </serial>
Nov 14 18:07:35 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:07:35 user nova-compute[76161]:     <video>
Nov 14 18:07:35 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:07:35 user nova-compute[76161]:     </video>
Nov 14 18:07:35 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:07:35 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:07:35 user nova-compute[76161]:     </rng>
Nov 14 18:07:35 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:07:35 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:07:35 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:07:35 user nova-compute[76161]:     </memballoon>
Nov 14 18:07:35 user nova-compute[76161]:   </devices>
Nov 14 18:07:35 user nova-compute[76161]: </domain>
Nov 14 18:07:35 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1076990849',display_name='tempest-ServerRescueNegativeTestJSON-server-1076990849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1076990849',id=41,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBeZoRV3kMXn/GA46eMNNcJ0tRZceNHh7TAIS5rF1neUcM4S6sNuRCXF0QtpQeXfc7hMCS+WkohSV8NcLF0hT2hw1cucJ9T0krp596vdpHjZgIxTbNUVRRJKYsl61TLWA==',key_name='tempest-keypair-719486534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-puohjd9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=e4f6135c-879b-4a15-8798-b6d83e5823da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:8a:b9,bridge_name='br-int',has_traffic_filtering=True,id=5296e396-4864-4119-a35b-bc4eb12284c1,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296e396-48') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG os_vif [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:8a:b9,bridge_name='br-int',has_traffic_filtering=True,id=5296e396-4864-4119-a35b-bc4eb12284c1,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296e396-48') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0efbe7a2-b58d-5105-ace4-494fccb1ab22', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5296e396-48, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5296e396-48, col_values=(('qos', UUID('01964561-9eb5-41a7-83b4-11038bb5fcb0')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5296e396-48, col_values=(('external_ids', {'iface-id': '5296e396-4864-4119-a35b-bc4eb12284c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:8a:b9', 'vm-uuid': 'e4f6135c-879b-4a15-8798-b6d83e5823da'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:35 user nova-compute[76161]: INFO os_vif [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:8a:b9,bridge_name='br-int',has_traffic_filtering=True,id=5296e396-4864-4119-a35b-bc4eb12284c1,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296e396-48')
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No VIF found with MAC fa:16:3e:38:8a:b9, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.network.neutron [req-44637c2c-3796-44dc-b1ea-0959a40747e2 req-c0edc300-a1d3-49f6-831b-1cb2aad54dcd service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updated VIF entry in instance network info cache for port 5296e396-4864-4119-a35b-bc4eb12284c1. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG nova.network.neutron [req-44637c2c-3796-44dc-b1ea-0959a40747e2 req-c0edc300-a1d3-49f6-831b-1cb2aad54dcd service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updating instance_info_cache with network_info: [{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:07:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-44637c2c-3796-44dc-b1ea-0959a40747e2 req-c0edc300-a1d3-49f6-831b-1cb2aad54dcd service nova] Releasing lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:07:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-7e7a54a6-8fd3-4767-be3c-832b0b5e5a7c req-1833fcfa-1d71-468e-b47c-43b1ce796854 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7e7a54a6-8fd3-4767-be3c-832b0b5e5a7c req-1833fcfa-1d71-468e-b47c-43b1ce796854 service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7e7a54a6-8fd3-4767-be3c-832b0b5e5a7c req-1833fcfa-1d71-468e-b47c-43b1ce796854 service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7e7a54a6-8fd3-4767-be3c-832b0b5e5a7c req-1833fcfa-1d71-468e-b47c-43b1ce796854 service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-7e7a54a6-8fd3-4767-be3c-832b0b5e5a7c req-1833fcfa-1d71-468e-b47c-43b1ce796854 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:07:37 user nova-compute[76161]: WARNING nova.compute.manager [req-7e7a54a6-8fd3-4767-be3c-832b0b5e5a7c req-1833fcfa-1d71-468e-b47c-43b1ce796854 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state building and task_state spawning.
Nov 14 18:07:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:07:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:07:38 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Instance spawned successfully.
Nov 14 18:07:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:07:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:38 user nova-compute[76161]: INFO nova.compute.manager [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 14 18:07:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:07:39 user nova-compute[76161]: INFO nova.compute.manager [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Took 6.10 seconds to build instance.
Nov 14 18:07:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f4c83bba-1866-4d01-95f8-5615569951d4 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.211s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-0f6e6068-235d-420e-88d7-92e9d4760106 req-ffb654a0-f9c8-421b-94c5-8f656ea53fad service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0f6e6068-235d-420e-88d7-92e9d4760106 req-ffb654a0-f9c8-421b-94c5-8f656ea53fad service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0f6e6068-235d-420e-88d7-92e9d4760106 req-ffb654a0-f9c8-421b-94c5-8f656ea53fad service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0f6e6068-235d-420e-88d7-92e9d4760106 req-ffb654a0-f9c8-421b-94c5-8f656ea53fad service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:39 user nova-compute[76161]: DEBUG nova.compute.manager [req-0f6e6068-235d-420e-88d7-92e9d4760106 req-ffb654a0-f9c8-421b-94c5-8f656ea53fad service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:07:39 user nova-compute[76161]: WARNING nova.compute.manager [req-0f6e6068-235d-420e-88d7-92e9d4760106 req-ffb654a0-f9c8-421b-94c5-8f656ea53fad service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state active and task_state None.
Nov 14 18:07:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:07:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:07:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:07:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:07:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:07:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:51 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:07:51 user nova-compute[76161]: INFO nova.compute.claims [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Claim successful on node user
Nov 14 18:07:52 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG nova.compute.manager [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG nova.compute.manager [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG nova.network.neutron [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:07:52 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:07:52 user nova-compute[76161]: DEBUG nova.compute.manager [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG nova.policy [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89b7172f3aea4ef29587ca01c39be2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0413439dcb2e49d496bf267c63163178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG nova.compute.manager [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:07:52 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Creating image(s)
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "/opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "/opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk 1073741824" returned: 0 in 0.046s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG nova.network.neutron [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Successfully created port: 7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Cannot resize image /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Ensure instance console log exists: /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-e0a200dc-9f05-4805-bf7c-a69b4f828b1f req-27469125-6388-46c7-97c7-714622b069a9 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received event network-changed-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-e0a200dc-9f05-4805-bf7c-a69b4f828b1f req-27469125-6388-46c7-97c7-714622b069a9 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Refreshing instance network info cache due to event network-changed-fbdc6a40-096f-4f70-8a59-a478924938ad. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e0a200dc-9f05-4805-bf7c-a69b4f828b1f req-27469125-6388-46c7-97c7-714622b069a9 service nova] Acquiring lock "refresh_cache-a0ec5fe2-517b-498c-8606-9417432c8803" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e0a200dc-9f05-4805-bf7c-a69b4f828b1f req-27469125-6388-46c7-97c7-714622b069a9 service nova] Acquired lock "refresh_cache-a0ec5fe2-517b-498c-8606-9417432c8803" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:07:53 user nova-compute[76161]: DEBUG nova.network.neutron [req-e0a200dc-9f05-4805-bf7c-a69b4f828b1f req-27469125-6388-46c7-97c7-714622b069a9 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Refreshing network info cache for port fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.neutron [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Successfully updated port: 7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "refresh_cache-3a02e8f0-7228-4dde-8c34-55a94356362c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquired lock "refresh_cache-3a02e8f0-7228-4dde-8c34-55a94356362c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.neutron [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-784c0a57-e843-48a4-8eac-24f476c9060b req-3191d153-e632-48e3-9d39-fef570f9ef85 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received event network-changed-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-784c0a57-e843-48a4-8eac-24f476c9060b req-3191d153-e632-48e3-9d39-fef570f9ef85 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Refreshing instance network info cache due to event network-changed-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-784c0a57-e843-48a4-8eac-24f476c9060b req-3191d153-e632-48e3-9d39-fef570f9ef85 service nova] Acquiring lock "refresh_cache-3a02e8f0-7228-4dde-8c34-55a94356362c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-e0a200dc-9f05-4805-bf7c-a69b4f828b1f req-27469125-6388-46c7-97c7-714622b069a9 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Updated VIF entry in instance network info cache for port fbdc6a40-096f-4f70-8a59-a478924938ad. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-e0a200dc-9f05-4805-bf7c-a69b4f828b1f req-27469125-6388-46c7-97c7-714622b069a9 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Updating instance_info_cache with network_info: [{"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.neutron [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e0a200dc-9f05-4805-bf7c-a69b4f828b1f req-27469125-6388-46c7-97c7-714622b069a9 service nova] Releasing lock "refresh_cache-a0ec5fe2-517b-498c-8606-9417432c8803" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.neutron [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Updating instance_info_cache with network_info: [{"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Releasing lock "refresh_cache-3a02e8f0-7228-4dde-8c34-55a94356362c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.compute.manager [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Instance network_info: |[{"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-784c0a57-e843-48a4-8eac-24f476c9060b req-3191d153-e632-48e3-9d39-fef570f9ef85 service nova] Acquired lock "refresh_cache-3a02e8f0-7228-4dde-8c34-55a94356362c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-784c0a57-e843-48a4-8eac-24f476c9060b req-3191d153-e632-48e3-9d39-fef570f9ef85 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Refreshing network info cache for port 7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Start _get_guest_xml network_info=[{"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:07:54 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:07:54 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1844963921',display_name='tempest-AttachVolumeTestJSON-server-1844963921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1844963921',id=42,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJt4KDe0SjR6HprUvNPeZnYFjsLoaDm7wAD7BrxUPzemNaFjz+ipxNJDEUSvPaT4I1EktQFg9ilGD8+uze53wSnEQypDeULh/vFtcTLt3bF7CljzFR5gTjm85I2LvANkzg==',key_name='tempest-keypair-246721526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-moyxp854',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=3a02e8f0-7228-4dde-8c34-55a94356362c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:89:e1,bridge_name='br-int',has_traffic_filtering=True,id=7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7554ffa2-25') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.objects.instance [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a02e8f0-7228-4dde-8c34-55a94356362c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:07:54 user nova-compute[76161]:   <uuid>3a02e8f0-7228-4dde-8c34-55a94356362c</uuid>
Nov 14 18:07:54 user nova-compute[76161]:   <name>instance-0000002a</name>
Nov 14 18:07:54 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:07:54 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:07:54 user nova-compute[76161]:   <metadata>
Nov 14 18:07:54 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:07:54 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:07:54 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeTestJSON-server-1844963921</nova:name>
Nov 14 18:07:54 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:07:54</nova:creationTime>
Nov 14 18:07:54 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:07:54 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:07:54 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:07:54 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:07:54 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:07:54 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:07:54 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:07:54 user nova-compute[76161]:       <nova:owner>
Nov 14 18:07:54 user nova-compute[76161]:         <nova:user uuid="89b7172f3aea4ef29587ca01c39be2f6">tempest-AttachVolumeTestJSON-1978358229-project-member</nova:user>
Nov 14 18:07:54 user nova-compute[76161]:         <nova:project uuid="0413439dcb2e49d496bf267c63163178">tempest-AttachVolumeTestJSON-1978358229</nova:project>
Nov 14 18:07:54 user nova-compute[76161]:       </nova:owner>
Nov 14 18:07:54 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:07:54 user nova-compute[76161]:       <nova:ports>
Nov 14 18:07:54 user nova-compute[76161]:         <nova:port uuid="7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e">
Nov 14 18:07:54 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 18:07:54 user nova-compute[76161]:         </nova:port>
Nov 14 18:07:54 user nova-compute[76161]:       </nova:ports>
Nov 14 18:07:54 user nova-compute[76161]:     </nova:instance>
Nov 14 18:07:54 user nova-compute[76161]:   </metadata>
Nov 14 18:07:54 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:07:54 user nova-compute[76161]:     <system>
Nov 14 18:07:54 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:07:54 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:07:54 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:07:54 user nova-compute[76161]:       <entry name="serial">3a02e8f0-7228-4dde-8c34-55a94356362c</entry>
Nov 14 18:07:54 user nova-compute[76161]:       <entry name="uuid">3a02e8f0-7228-4dde-8c34-55a94356362c</entry>
Nov 14 18:07:54 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:07:54 user nova-compute[76161]:     </system>
Nov 14 18:07:54 user nova-compute[76161]:   </sysinfo>
Nov 14 18:07:54 user nova-compute[76161]:   <os>
Nov 14 18:07:54 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:07:54 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:07:54 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:07:54 user nova-compute[76161]:   </os>
Nov 14 18:07:54 user nova-compute[76161]:   <features>
Nov 14 18:07:54 user nova-compute[76161]:     <acpi/>
Nov 14 18:07:54 user nova-compute[76161]:     <apic/>
Nov 14 18:07:54 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:07:54 user nova-compute[76161]:   </features>
Nov 14 18:07:54 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:07:54 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:07:54 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:07:54 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:07:54 user nova-compute[76161]:   </clock>
Nov 14 18:07:54 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:07:54 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:07:54 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:07:54 user nova-compute[76161]:   </cpu>
Nov 14 18:07:54 user nova-compute[76161]:   <devices>
Nov 14 18:07:54 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:07:54 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:07:54 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk"/>
Nov 14 18:07:54 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:07:54 user nova-compute[76161]:     </disk>
Nov 14 18:07:54 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:07:54 user nova-compute[76161]:       <mac address="fa:16:3e:7b:89:e1"/>
Nov 14 18:07:54 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:07:54 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:07:54 user nova-compute[76161]:       <target dev="tap7554ffa2-25"/>
Nov 14 18:07:54 user nova-compute[76161]:     </interface>
Nov 14 18:07:54 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:07:54 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/console.log" append="off"/>
Nov 14 18:07:54 user nova-compute[76161]:     </serial>
Nov 14 18:07:54 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:07:54 user nova-compute[76161]:     <video>
Nov 14 18:07:54 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:07:54 user nova-compute[76161]:     </video>
Nov 14 18:07:54 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:07:54 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:07:54 user nova-compute[76161]:     </rng>
Nov 14 18:07:54 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:07:54 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:07:54 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:07:54 user nova-compute[76161]:     </memballoon>
Nov 14 18:07:54 user nova-compute[76161]:   </devices>
Nov 14 18:07:54 user nova-compute[76161]: </domain>
Nov 14 18:07:54 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1844963921',display_name='tempest-AttachVolumeTestJSON-server-1844963921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1844963921',id=42,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJt4KDe0SjR6HprUvNPeZnYFjsLoaDm7wAD7BrxUPzemNaFjz+ipxNJDEUSvPaT4I1EktQFg9ilGD8+uze53wSnEQypDeULh/vFtcTLt3bF7CljzFR5gTjm85I2LvANkzg==',key_name='tempest-keypair-246721526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-moyxp854',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=3a02e8f0-7228-4dde-8c34-55a94356362c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:89:e1,bridge_name='br-int',has_traffic_filtering=True,id=7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7554ffa2-25') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG os_vif [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:89:e1,bridge_name='br-int',has_traffic_filtering=True,id=7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7554ffa2-25') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '761c5a52-0fd5-5aa3-91d8-5b9e618ff1f6', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7554ffa2-25, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7554ffa2-25, col_values=(('qos', UUID('a6da5417-22cc-41fe-8414-164001ee061b')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7554ffa2-25, col_values=(('external_ids', {'iface-id': '7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:89:e1', 'vm-uuid': '3a02e8f0-7228-4dde-8c34-55a94356362c'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:54 user nova-compute[76161]: INFO os_vif [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:89:e1,bridge_name='br-int',has_traffic_filtering=True,id=7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7554ffa2-25')
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No VIF found with MAC fa:16:3e:7b:89:e1, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-784c0a57-e843-48a4-8eac-24f476c9060b req-3191d153-e632-48e3-9d39-fef570f9ef85 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Updated VIF entry in instance network info cache for port 7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG nova.network.neutron [req-784c0a57-e843-48a4-8eac-24f476c9060b req-3191d153-e632-48e3-9d39-fef570f9ef85 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Updating instance_info_cache with network_info: [{"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:07:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-784c0a57-e843-48a4-8eac-24f476c9060b req-3191d153-e632-48e3-9d39-fef570f9ef85 service nova] Releasing lock "refresh_cache-3a02e8f0-7228-4dde-8c34-55a94356362c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:07:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-766482a7-f5b7-4a5d-b8cd-2fe930c599fa req-5e1d84b3-21c7-4eaf-9016-899940edaf37 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received event network-vif-plugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-766482a7-f5b7-4a5d-b8cd-2fe930c599fa req-5e1d84b3-21c7-4eaf-9016-899940edaf37 service nova] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-766482a7-f5b7-4a5d-b8cd-2fe930c599fa req-5e1d84b3-21c7-4eaf-9016-899940edaf37 service nova] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-766482a7-f5b7-4a5d-b8cd-2fe930c599fa req-5e1d84b3-21c7-4eaf-9016-899940edaf37 service nova] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-766482a7-f5b7-4a5d-b8cd-2fe930c599fa req-5e1d84b3-21c7-4eaf-9016-899940edaf37 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] No waiting events found dispatching network-vif-plugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:07:56 user nova-compute[76161]: WARNING nova.compute.manager [req-766482a7-f5b7-4a5d-b8cd-2fe930c599fa req-5e1d84b3-21c7-4eaf-9016-899940edaf37 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received unexpected event network-vif-plugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e for instance with vm_state building and task_state spawning.
Nov 14 18:07:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:07:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Instance spawned successfully.
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-23905add-9eae-4f8a-ab29-e04acef43d31 req-65d9f757-e85f-493b-bc80-9465271274b8 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received event network-vif-plugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23905add-9eae-4f8a-ab29-e04acef43d31 req-65d9f757-e85f-493b-bc80-9465271274b8 service nova] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23905add-9eae-4f8a-ab29-e04acef43d31 req-65d9f757-e85f-493b-bc80-9465271274b8 service nova] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23905add-9eae-4f8a-ab29-e04acef43d31 req-65d9f757-e85f-493b-bc80-9465271274b8 service nova] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.compute.manager [req-23905add-9eae-4f8a-ab29-e04acef43d31 req-65d9f757-e85f-493b-bc80-9465271274b8 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] No waiting events found dispatching network-vif-plugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:07:58 user nova-compute[76161]: WARNING nova.compute.manager [req-23905add-9eae-4f8a-ab29-e04acef43d31 req-65d9f757-e85f-493b-bc80-9465271274b8 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received unexpected event network-vif-plugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e for instance with vm_state building and task_state spawning.
Nov 14 18:07:58 user nova-compute[76161]: INFO nova.compute.manager [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 14 18:07:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:07:58 user nova-compute[76161]: INFO nova.compute.manager [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Took 6.65 seconds to build instance.
Nov 14 18:07:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aa85d521-64c4-4c98-ac8d-624f31bf7f32 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.763s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:07:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:07:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "0413997a-4ae9-4b6e-8571-6e2174d7f105" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:59 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:07:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:07:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:07:59 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:07:59 user nova-compute[76161]: INFO nova.compute.claims [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Claim successful on node user
Nov 14 18:08:00 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:08:00 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:08:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:08:00 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:08:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:08:00 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:08:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:08:00 user nova-compute[76161]: INFO nova.virt.block_device [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Booting with volume snapshot 478d24fe-35cd-460f-b0d5-6ff70de32b94 at /dev/vda
Nov 14 18:08:00 user nova-compute[76161]: DEBUG nova.policy [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd22a86988e6043d2ab950e0d6e557ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81682e21827c4572b1659004cc22215a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:08:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:00 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Successfully created port: 57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Successfully updated port: 57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "refresh_cache-0413997a-4ae9-4b6e-8571-6e2174d7f105" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquired lock "refresh_cache-0413997a-4ae9-4b6e-8571-6e2174d7f105" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-597c3090-454e-4e1b-8742-3f94ebd26ed8 req-d0496ecb-462d-4cbe-8868-30b77b97155d service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received event network-changed-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-597c3090-454e-4e1b-8742-3f94ebd26ed8 req-d0496ecb-462d-4cbe-8868-30b77b97155d service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Refreshing instance network info cache due to event network-changed-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-597c3090-454e-4e1b-8742-3f94ebd26ed8 req-d0496ecb-462d-4cbe-8868-30b77b97155d service nova] Acquiring lock "refresh_cache-0413997a-4ae9-4b6e-8571-6e2174d7f105" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Updating instance_info_cache with network_info: [{"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Releasing lock "refresh_cache-0413997a-4ae9-4b6e-8571-6e2174d7f105" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Instance network_info: |[{"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-597c3090-454e-4e1b-8742-3f94ebd26ed8 req-d0496ecb-462d-4cbe-8868-30b77b97155d service nova] Acquired lock "refresh_cache-0413997a-4ae9-4b6e-8571-6e2174d7f105" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:08:01 user nova-compute[76161]: DEBUG nova.network.neutron [req-597c3090-454e-4e1b-8742-3f94ebd26ed8 req-d0496ecb-462d-4cbe-8868-30b77b97155d service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Refreshing network info cache for port 57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:08:02 user nova-compute[76161]: DEBUG nova.network.neutron [req-597c3090-454e-4e1b-8742-3f94ebd26ed8 req-d0496ecb-462d-4cbe-8868-30b77b97155d service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Updated VIF entry in instance network info cache for port 57f5732d-c5a0-4e2c-81b8-f34e4cae97a2. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:08:02 user nova-compute[76161]: DEBUG nova.network.neutron [req-597c3090-454e-4e1b-8742-3f94ebd26ed8 req-d0496ecb-462d-4cbe-8868-30b77b97155d service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Updating instance_info_cache with network_info: [{"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:08:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-597c3090-454e-4e1b-8742-3f94ebd26ed8 req-d0496ecb-462d-4cbe-8868-30b77b97155d service nova] Releasing lock "refresh_cache-0413997a-4ae9-4b6e-8571-6e2174d7f105" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:03 user nova-compute[76161]: INFO nova.compute.manager [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Terminating instance
Nov 14 18:08:03 user nova-compute[76161]: DEBUG nova.compute.manager [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-d6a524d1-d7a8-4b4e-9f66-46452cd468f7 req-41aa5194-1f75-40f4-bb1d-2ec2405e9f89 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-unplugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d6a524d1-d7a8-4b4e-9f66-46452cd468f7 req-41aa5194-1f75-40f4-bb1d-2ec2405e9f89 service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d6a524d1-d7a8-4b4e-9f66-46452cd468f7 req-41aa5194-1f75-40f4-bb1d-2ec2405e9f89 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d6a524d1-d7a8-4b4e-9f66-46452cd468f7 req-41aa5194-1f75-40f4-bb1d-2ec2405e9f89 service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-d6a524d1-d7a8-4b4e-9f66-46452cd468f7 req-41aa5194-1f75-40f4-bb1d-2ec2405e9f89 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-unplugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:08:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-d6a524d1-d7a8-4b4e-9f66-46452cd468f7 req-41aa5194-1f75-40f4-bb1d-2ec2405e9f89 service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-unplugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:08:04 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Instance destroyed successfully.
Nov 14 18:08:04 user nova-compute[76161]: DEBUG nova.objects.instance [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'resources' on Instance uuid e6b27e32-d956-4f41-b278-d7d088c7edbc {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1186448522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1186448522',id=14,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:54:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-c0ltbv0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:56:01Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=e6b27e32-d956-4f41-b278-d7d088c7edbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "420627a0-11f4-43cc-b08c-84739104b43c", "address": "fa:16:3e:96:f2:43", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420627a0-11", "ovs_interfaceid": "420627a0-11f4-43cc-b08c-84739104b43c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=420627a0-11f4-43cc-b08c-84739104b43c,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420627a0-11') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_vif [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=420627a0-11f4-43cc-b08c-84739104b43c,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420627a0-11') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap420627a0-11, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c85f238-0914-4ed5-bc78-26a22f4d09f7) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:08:04 user nova-compute[76161]: INFO os_vif [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f2:43,bridge_name='br-int',has_traffic_filtering=True,id=420627a0-11f4-43cc-b08c-84739104b43c,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420627a0-11')
Nov 14 18:08:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eptJSETF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:08:04 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[60149df6-9dde-45ab-beaa-51b1044551f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:08:04 user nova-compute[76161]: No targets found.
Nov 14 18:08:04 user nova-compute[76161]: iSNS:
Nov 14 18:08:04 user nova-compute[76161]: No targets found.
Nov 14 18:08:04 user nova-compute[76161]: STATIC:
Nov 14 18:08:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c
Nov 14 18:08:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:08:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:08:04 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea
Nov 14 18:08:04 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:08:04 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:08:04 user nova-compute[76161]: FIRMWARE:
Nov 14 18:08:04 user nova-compute[76161]: No targets found.
Nov 14 18:08:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:08:04 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:08:04 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[549f33c3-cca8-4625-aafb-dd7b6e172ed3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[31053ab9-6a0f-4d8d-979e-e59955725cef]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:08:04 user nova-compute[76161]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:08:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c (non-flash)
Nov 14 18:08:04 user nova-compute[76161]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:08:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f84236d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c'): ({'sdd'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Removing single pathed devices sdd {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f969a3a6-8d3b-40ed-b348-f44d8608246d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a893aa8-575a-45c5-b71f-2ea693a731a4]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Flushing IO for device /dev/sdd {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd91009b-5db1-4298-ae2d-d7d3002e12e3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe952a5-83d4-48f2-a71f-aa8a002037ad]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] SCSI volumes sdd have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e657a-2d2d-4fb0-8f79-26ab35a8ddab]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[855fee2f-5755-4237-a2e7-dcb98185e250]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c, portal: 172.16.0.220,3260]
Nov 14 18:08:04 user nova-compute[76161]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c, portal: 172.16.0.220,3260] successful.
Nov 14 18:08:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5146bbb8-274b-49d7-864b-1333d8f9479c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[004f688c-9139-4756-ada9-2c7442e561b8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] <== disconnect_volume: return (308ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:08:04 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Deleting instance files /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc_del
Nov 14 18:08:04 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Deletion of /opt/stack/data/nova/instances/e6b27e32-d956-4f41-b278-d7d088c7edbc_del complete
Nov 14 18:08:04 user nova-compute[76161]: INFO nova.compute.manager [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 18:08:04 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:08:04 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:08:04 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Took 0.46 seconds to deallocate network for instance.
Nov 14 18:08:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:05 user nova-compute[76161]: INFO nova.compute.manager [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 18:08:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-1545823d-a070-48a8-a10e-dec368835cf2 req-f14b14ed-3941-4caa-8079-f82e41e0d92f service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1545823d-a070-48a8-a10e-dec368835cf2 req-f14b14ed-3941-4caa-8079-f82e41e0d92f service nova] Acquiring lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1545823d-a070-48a8-a10e-dec368835cf2 req-f14b14ed-3941-4caa-8079-f82e41e0d92f service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1545823d-a070-48a8-a10e-dec368835cf2 req-f14b14ed-3941-4caa-8079-f82e41e0d92f service nova] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-1545823d-a070-48a8-a10e-dec368835cf2 req-f14b14ed-3941-4caa-8079-f82e41e0d92f service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] No waiting events found dispatching network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:08:05 user nova-compute[76161]: WARNING nova.compute.manager [req-1545823d-a070-48a8-a10e-dec368835cf2 req-f14b14ed-3941-4caa-8079-f82e41e0d92f service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received unexpected event network-vif-plugged-420627a0-11f4-43cc-b08c-84739104b43c for instance with vm_state deleted and task_state None.
Nov 14 18:08:05 user nova-compute[76161]: DEBUG nova.compute.manager [req-1545823d-a070-48a8-a10e-dec368835cf2 req-f14b14ed-3941-4caa-8079-f82e41e0d92f service nova] [instance: e6b27e32-d956-4f41-b278-d7d088c7edbc] Received event network-vif-deleted-420627a0-11f4-43cc-b08c-84739104b43c {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:05 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:08:05 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:08:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG os_brick.utils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:08:06 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Deleted allocations for instance e6b27e32-d956-4f41-b278-d7d088c7edbc
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[270ee4b3-3b65-4499-89a7-869ac629d0e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[14886b6c-febd-4ab3-8d7b-4714d57dbaa4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdf41cd-30ee-43f5-b74a-b11282e1a5f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23f4ec7-16e2-447d-9069-ca120f5dc9a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-a283ee93-a7bc-4cea-820f-c6315553ef35 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "e6b27e32-d956-4f41-b278-d7d088c7edbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.864s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:08:06 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:08:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc009f3d-217e-487c-861a-a9e268a332fb]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG os_brick.utils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:08:06 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Updating existing volume attachment record: e80c4aff-8568-4f6e-a228-e014d22ad706 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:08:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:08:10 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Creating image(s)
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Ensure instance console log exists: /opt/stack/data/nova/instances/0413997a-4ae9-4b6e-8571-6e2174d7f105/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Start _get_guest_xml network_info=[{"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T18:07:55Z,direct_url=<?>,disk_format='qcow2',id=8488e486-f2cf-499f-a2bd-03ef1be174ed,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1982366325',owner='81682e21827c4572b1659004cc22215a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T18:07:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWxpbBJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0413997a-4ae9-4b6e-8571-6e2174d7f105', 'attached_at': '', 'detached_at': '', 'volume_id': '760b6962-f868-49f4-af5d-1caf729971e3', 'serial': '760b6962-f868-49f4-af5d-1caf729971e3'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'e80c4aff-8568-4f6e-a228-e014d22ad706', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:08:10 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:08:10 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T18:07:55Z,direct_url=<?>,disk_format='qcow2',id=8488e486-f2cf-499f-a2bd-03ef1be174ed,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1982366325',owner='81682e21827c4572b1659004cc22215a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T18:07:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWxpbBJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:08:10 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:08:10 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:08:10 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b348a828-16fc-43fa-a7ad-55079df0ed3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:08:10 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80e8bce-eb45-4219-86b4-e8dc282b1ecd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3] added
Nov 14 18:08:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a920e6-1459-46d6-94d1-2f9d1edf9e46]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94d4b70-13d4-4e52-8534-1ae983c88bc0]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWxpbBJR {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWxpbBJR" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd48ed-9fd4-4fef-afa3-7fed4073b736]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SWxpbBJR'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28dcd0b-65fb-4c12-ba7a-a767ca14dd2b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[72167a4e-f38a-492e-a6ba-f66971705323]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:08:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:08:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b16556b-b268-4f6d-adf9-2a6e64dedf7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3, portal: 172.16.0.220,3260]
Nov 14 18:08:10 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3, portal: 172.16.0.220,3260] successful.
Nov 14 18:08:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[998d0a4d-8f5f-41b9-8b36-f1c277bf9e4c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a26998a-86ca-48de-8629-d10b11395617]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:08:11 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:08:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:08:11 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:08:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabe3fa8-b4d6-4bf5-81cf-d74c9ff0710a]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:08:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWxpbBJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26465323032333032', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465323032333032', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1266418046',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1266418046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1266418046',id=43,image_ref='8488e486-f2cf-499f-a2bd-03ef1be174ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL44Zk9nIs5KKtEoYejFwRH/28g6JywZg0r63ax6DFaKfNicku1ohPFzArX/DGC+k3VHZyV9Uy261sTzO9cYkGA9Ww5drtqOtZ+9g5IXuXJGslOQkwGBzQYwMPXs2uz4g==',key_name='tempest-keypair-2011080648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-rs0pvigd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1727647616',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=0413997a-4ae9-4b6e-8571-6e2174d7f105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:9f:8d,bridge_name='br-int',has_traffic_filtering=True,id=57f5732d-c5a0-4e2c-81b8-f34e4cae97a2,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f5732d-c5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'pci_devices' on Instance uuid 0413997a-4ae9-4b6e-8571-6e2174d7f105 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:08:12 user nova-compute[76161]:   <uuid>0413997a-4ae9-4b6e-8571-6e2174d7f105</uuid>
Nov 14 18:08:12 user nova-compute[76161]:   <name>instance-0000002b</name>
Nov 14 18:08:12 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:08:12 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:08:12 user nova-compute[76161]:   <metadata>
Nov 14 18:08:12 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:08:12 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:08:12 user nova-compute[76161]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1266418046</nova:name>
Nov 14 18:08:12 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:08:10</nova:creationTime>
Nov 14 18:08:12 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:08:12 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:08:12 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:08:12 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:08:12 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:08:12 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:08:12 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:08:12 user nova-compute[76161]:       <nova:owner>
Nov 14 18:08:12 user nova-compute[76161]:         <nova:user uuid="d22a86988e6043d2ab950e0d6e557ef8">tempest-TestVolumeBootPattern-1727647616-project-member</nova:user>
Nov 14 18:08:12 user nova-compute[76161]:         <nova:project uuid="81682e21827c4572b1659004cc22215a">tempest-TestVolumeBootPattern-1727647616</nova:project>
Nov 14 18:08:12 user nova-compute[76161]:       </nova:owner>
Nov 14 18:08:12 user nova-compute[76161]:       <nova:root type="image" uuid="8488e486-f2cf-499f-a2bd-03ef1be174ed"/>
Nov 14 18:08:12 user nova-compute[76161]:       <nova:ports>
Nov 14 18:08:12 user nova-compute[76161]:         <nova:port uuid="57f5732d-c5a0-4e2c-81b8-f34e4cae97a2">
Nov 14 18:08:12 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 18:08:12 user nova-compute[76161]:         </nova:port>
Nov 14 18:08:12 user nova-compute[76161]:       </nova:ports>
Nov 14 18:08:12 user nova-compute[76161]:     </nova:instance>
Nov 14 18:08:12 user nova-compute[76161]:   </metadata>
Nov 14 18:08:12 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:08:12 user nova-compute[76161]:     <system>
Nov 14 18:08:12 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:08:12 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:08:12 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:08:12 user nova-compute[76161]:       <entry name="serial">0413997a-4ae9-4b6e-8571-6e2174d7f105</entry>
Nov 14 18:08:12 user nova-compute[76161]:       <entry name="uuid">0413997a-4ae9-4b6e-8571-6e2174d7f105</entry>
Nov 14 18:08:12 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:08:12 user nova-compute[76161]:     </system>
Nov 14 18:08:12 user nova-compute[76161]:   </sysinfo>
Nov 14 18:08:12 user nova-compute[76161]:   <os>
Nov 14 18:08:12 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:08:12 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:08:12 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:08:12 user nova-compute[76161]:   </os>
Nov 14 18:08:12 user nova-compute[76161]:   <features>
Nov 14 18:08:12 user nova-compute[76161]:     <acpi/>
Nov 14 18:08:12 user nova-compute[76161]:     <apic/>
Nov 14 18:08:12 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:08:12 user nova-compute[76161]:   </features>
Nov 14 18:08:12 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:08:12 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:08:12 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:08:12 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:08:12 user nova-compute[76161]:   </clock>
Nov 14 18:08:12 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:08:12 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:08:12 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:08:12 user nova-compute[76161]:   </cpu>
Nov 14 18:08:12 user nova-compute[76161]:   <devices>
Nov 14 18:08:12 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:08:12 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:08:12 user nova-compute[76161]:       <source dev="/dev/sdc"/>
Nov 14 18:08:12 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:08:12 user nova-compute[76161]:       <serial>760b6962-f868-49f4-af5d-1caf729971e3</serial>
Nov 14 18:08:12 user nova-compute[76161]:     </disk>
Nov 14 18:08:12 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:08:12 user nova-compute[76161]:       <mac address="fa:16:3e:87:9f:8d"/>
Nov 14 18:08:12 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:08:12 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:08:12 user nova-compute[76161]:       <target dev="tap57f5732d-c5"/>
Nov 14 18:08:12 user nova-compute[76161]:     </interface>
Nov 14 18:08:12 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:08:12 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/0413997a-4ae9-4b6e-8571-6e2174d7f105/console.log" append="off"/>
Nov 14 18:08:12 user nova-compute[76161]:     </serial>
Nov 14 18:08:12 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:08:12 user nova-compute[76161]:     <video>
Nov 14 18:08:12 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:08:12 user nova-compute[76161]:     </video>
Nov 14 18:08:12 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:08:12 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:08:12 user nova-compute[76161]:     </rng>
Nov 14 18:08:12 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:08:12 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:08:12 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:08:12 user nova-compute[76161]:     </memballoon>
Nov 14 18:08:12 user nova-compute[76161]:   </devices>
Nov 14 18:08:12 user nova-compute[76161]: </domain>
Nov 14 18:08:12 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1266418046',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1266418046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1266418046',id=43,image_ref='8488e486-f2cf-499f-a2bd-03ef1be174ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL44Zk9nIs5KKtEoYejFwRH/28g6JywZg0r63ax6DFaKfNicku1ohPFzArX/DGC+k3VHZyV9Uy261sTzO9cYkGA9Ww5drtqOtZ+9g5IXuXJGslOQkwGBzQYwMPXs2uz4g==',key_name='tempest-keypair-2011080648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-rs0pvigd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1727647616',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=0413997a-4ae9-4b6e-8571-6e2174d7f105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:9f:8d,bridge_name='br-int',has_traffic_filtering=True,id=57f5732d-c5a0-4e2c-81b8-f34e4cae97a2,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f5732d-c5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG os_vif [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:9f:8d,bridge_name='br-int',has_traffic_filtering=True,id=57f5732d-c5a0-4e2c-81b8-f34e4cae97a2,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f5732d-c5') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99a59fad-fc3a-5a9b-87f6-a78cf5094c01', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57f5732d-c5, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57f5732d-c5, col_values=(('qos', UUID('bc5648d4-5422-4bda-a5f1-ea4d7c868215')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57f5732d-c5, col_values=(('external_ids', {'iface-id': '57f5732d-c5a0-4e2c-81b8-f34e4cae97a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:9f:8d', 'vm-uuid': '0413997a-4ae9-4b6e-8571-6e2174d7f105'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:12 user nova-compute[76161]: INFO os_vif [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:9f:8d,bridge_name='br-int',has_traffic_filtering=True,id=57f5732d-c5a0-4e2c-81b8-f34e4cae97a2,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f5732d-c5')
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:08:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No VIF found with MAC fa:16:3e:87:9f:8d, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:08:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-4366eb6b-ffaa-4fd1-b7f9-dda119c7c1ec req-6b7935a4-b01e-4f14-893a-9829a5e176d6 service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received event network-vif-plugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4366eb6b-ffaa-4fd1-b7f9-dda119c7c1ec req-6b7935a4-b01e-4f14-893a-9829a5e176d6 service nova] Acquiring lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4366eb6b-ffaa-4fd1-b7f9-dda119c7c1ec req-6b7935a4-b01e-4f14-893a-9829a5e176d6 service nova] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4366eb6b-ffaa-4fd1-b7f9-dda119c7c1ec req-6b7935a4-b01e-4f14-893a-9829a5e176d6 service nova] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-4366eb6b-ffaa-4fd1-b7f9-dda119c7c1ec req-6b7935a4-b01e-4f14-893a-9829a5e176d6 service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] No waiting events found dispatching network-vif-plugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:08:13 user nova-compute[76161]: WARNING nova.compute.manager [req-4366eb6b-ffaa-4fd1-b7f9-dda119c7c1ec req-6b7935a4-b01e-4f14-893a-9829a5e176d6 service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received unexpected event network-vif-plugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 for instance with vm_state building and task_state spawning.
Nov 14 18:08:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:08:15 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Instance spawned successfully.
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:15 user nova-compute[76161]: INFO nova.compute.manager [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-aedc6354-3765-4f79-abc1-e4473a175fee req-4f73a65f-a383-430f-a209-6462792d9f14 service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received event network-vif-plugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aedc6354-3765-4f79-abc1-e4473a175fee req-4f73a65f-a383-430f-a209-6462792d9f14 service nova] Acquiring lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aedc6354-3765-4f79-abc1-e4473a175fee req-4f73a65f-a383-430f-a209-6462792d9f14 service nova] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aedc6354-3765-4f79-abc1-e4473a175fee req-4f73a65f-a383-430f-a209-6462792d9f14 service nova] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-aedc6354-3765-4f79-abc1-e4473a175fee req-4f73a65f-a383-430f-a209-6462792d9f14 service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] No waiting events found dispatching network-vif-plugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:08:15 user nova-compute[76161]: WARNING nova.compute.manager [req-aedc6354-3765-4f79-abc1-e4473a175fee req-4f73a65f-a383-430f-a209-6462792d9f14 service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received unexpected event network-vif-plugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 for instance with vm_state building and task_state spawning.
Nov 14 18:08:15 user nova-compute[76161]: INFO nova.compute.manager [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Took 15.95 seconds to build instance.
Nov 14 18:08:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c428e69d-3103-4ab5-9350-55d5d2698ee3 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.052s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-641882f2-7f06-4d1e-8751-bd82be17adc9 req-5b9d2504-c55d-4f54-91c2-56f2784236cc service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-changed-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-641882f2-7f06-4d1e-8751-bd82be17adc9 req-5b9d2504-c55d-4f54-91c2-56f2784236cc service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Refreshing instance network info cache due to event network-changed-3148c108-daab-4928-8c8c-35ed2c11a9bc. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-641882f2-7f06-4d1e-8751-bd82be17adc9 req-5b9d2504-c55d-4f54-91c2-56f2784236cc service nova] Acquiring lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-641882f2-7f06-4d1e-8751-bd82be17adc9 req-5b9d2504-c55d-4f54-91c2-56f2784236cc service nova] Acquired lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:08:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-641882f2-7f06-4d1e-8751-bd82be17adc9 req-5b9d2504-c55d-4f54-91c2-56f2784236cc service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Refreshing network info cache for port 3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:08:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-641882f2-7f06-4d1e-8751-bd82be17adc9 req-5b9d2504-c55d-4f54-91c2-56f2784236cc service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updated VIF entry in instance network info cache for port 3148c108-daab-4928-8c8c-35ed2c11a9bc. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:08:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-641882f2-7f06-4d1e-8751-bd82be17adc9 req-5b9d2504-c55d-4f54-91c2-56f2784236cc service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updating instance_info_cache with network_info: [{"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:08:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-641882f2-7f06-4d1e-8751-bd82be17adc9 req-5b9d2504-c55d-4f54-91c2-56f2784236cc service nova] Releasing lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:08:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "1040ce71-437b-4398-9bb5-bd34e86589a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:16 user nova-compute[76161]: INFO nova.compute.manager [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Terminating instance
Nov 14 18:08:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-0eadc741-6a34-4711-8df5-352b220f4ccf req-1bb97066-e06c-4a13-b36f-1fb79d44ab6a service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received event network-vif-unplugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0eadc741-6a34-4711-8df5-352b220f4ccf req-1bb97066-e06c-4a13-b36f-1fb79d44ab6a service nova] Acquiring lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0eadc741-6a34-4711-8df5-352b220f4ccf req-1bb97066-e06c-4a13-b36f-1fb79d44ab6a service nova] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0eadc741-6a34-4711-8df5-352b220f4ccf req-1bb97066-e06c-4a13-b36f-1fb79d44ab6a service nova] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-0eadc741-6a34-4711-8df5-352b220f4ccf req-1bb97066-e06c-4a13-b36f-1fb79d44ab6a service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] No waiting events found dispatching network-vif-unplugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-0eadc741-6a34-4711-8df5-352b220f4ccf req-1bb97066-e06c-4a13-b36f-1fb79d44ab6a service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received event network-vif-unplugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Instance destroyed successfully.
Nov 14 18:08:17 user nova-compute[76161]: DEBUG nova.objects.instance [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lazy-loading 'resources' on Instance uuid 1040ce71-437b-4398-9bb5-bd34e86589a7 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-777168735',display_name='tempest-ServerActionsTestOtherA-server-777168735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-777168735',id=5,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/qLMrSixUeoWRNqyyMAmkr6Jdv4puUPBA23tnedByCcFoj2iOZE+ZPEXsuKk/6jLGW1AaCT9PLvxK/WjfaizeZDXI/isTmP1fIOMxcZKPA16ZEa+3fb0iod0Nl+OKmuw==',key_name='tempest-keypair-197899952',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:49:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4467aca672a34c1a8f4e1735636d311b',ramdisk_id='',reservation_id='r-hl5mowhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-233736107',owner_user_name='tempest-ServerActionsTestOtherA-233736107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:49:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfeb35beb394e15bf881780f69724f6',uuid=1040ce71-437b-4398-9bb5-bd34e86589a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converting VIF {"id": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "address": "fa:16:3e:7a:71:11", "network": {"id": "26e9b88b-6e77-4298-b1b3-dd5d03ae326c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1890505256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4467aca672a34c1a8f4e1735636d311b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8e82122-b7", "ovs_interfaceid": "f8e82122-b7bf-4a06-b5cc-084e959e2e11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:71:11,bridge_name='br-int',has_traffic_filtering=True,id=f8e82122-b7bf-4a06-b5cc-084e959e2e11,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e82122-b7') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG os_vif [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:71:11,bridge_name='br-int',has_traffic_filtering=True,id=f8e82122-b7bf-4a06-b5cc-084e959e2e11,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e82122-b7') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8e82122-b7, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ac2c3a7-c3c3-474f-81ea-6bcb9468ed03) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:17 user nova-compute[76161]: INFO os_vif [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:71:11,bridge_name='br-int',has_traffic_filtering=True,id=f8e82122-b7bf-4a06-b5cc-084e959e2e11,network=Network(26e9b88b-6e77-4298-b1b3-dd5d03ae326c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8e82122-b7')
Nov 14 18:08:17 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Deleting instance files /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7_del
Nov 14 18:08:17 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Deletion of /opt/stack/data/nova/instances/1040ce71-437b-4398-9bb5-bd34e86589a7_del complete
Nov 14 18:08:17 user nova-compute[76161]: INFO nova.compute.manager [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 18:08:17 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:08:17 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:08:18 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Took 0.46 seconds to deallocate network for instance.
Nov 14 18:08:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-12919d3c-660d-4847-b36e-62555a8850a5 req-7f06c599-dbe0-4edf-a456-3f5af7ef7142 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received event network-vif-deleted-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:18 user nova-compute[76161]: INFO nova.compute.manager [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Shelving
Nov 14 18:08:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:08:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:18 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Deleted allocations for instance 1040ce71-437b-4398-9bb5-bd34e86589a7
Nov 14 18:08:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-029da6dc-4927-4b93-ac21-0ed549b9985f tempest-ServerActionsTestOtherA-233736107 tempest-ServerActionsTestOtherA-233736107-project-member] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received event network-vif-plugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] Acquiring lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] Lock "1040ce71-437b-4398-9bb5-bd34e86589a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] No waiting events found dispatching network-vif-plugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:08:19 user nova-compute[76161]: WARNING nova.compute.manager [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] [instance: 1040ce71-437b-4398-9bb5-bd34e86589a7] Received unexpected event network-vif-plugged-f8e82122-b7bf-4a06-b5cc-084e959e2e11 for instance with vm_state deleted and task_state None.
Nov 14 18:08:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-unplugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-unplugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:08:19 user nova-compute[76161]: WARNING nova.compute.manager [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-unplugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state active and task_state shelving.
Nov 14 18:08:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:08:19 user nova-compute[76161]: WARNING nova.compute.manager [req-7389eb66-1d43-4b64-9c2f-54f5ef0384b6 req-c89ed9b2-44a9-4860-9c86-bbf98dbf0676 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state active and task_state shelving.
Nov 14 18:08:19 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Instance destroyed successfully.
Nov 14 18:08:19 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Beginning cold snapshot process
Nov 14 18:08:19 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 18:08:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk /opt/stack/data/nova/instances/snapshots/tmp7mxrzc4k/94c99770eefc450aa6040d34213c1e64 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:20 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk /opt/stack/data/nova/instances/snapshots/tmp7mxrzc4k/94c99770eefc450aa6040d34213c1e64" returned: 0 in 0.578s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Snapshot extracted, beginning image upload
Nov 14 18:08:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:21 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:08:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:23 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Snapshot image upload complete
Nov 14 18:08:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:08:23 user nova-compute[76161]: INFO nova.compute.manager [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Shelve offloading
Nov 14 18:08:23 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Instance destroyed successfully.
Nov 14 18:08:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquired lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updating instance_info_cache with network_info: [{"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Releasing lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Updating instance_info_cache with network_info: [{"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:08:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:08:23 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Instance destroyed successfully.
Nov 14 18:08:23 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'resources' on Instance uuid 30f22af1-c024-4da6-bf55-7fba565bd50b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109152857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109152857',id=40,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2NrH89/xsrXPPHHpfe9xbUselmuX915kYvkiHsNDk/HGgGXPKFEZCO4dEkj3yYeaW8Gko12Y2GSDL2vNeUvyfj7Ova4pX5Y2tpWfReAklnKCXZB0RfvANMe0KAvhs37g==',key_name='tempest-keypair-2021075801',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-2okswtgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member',shelved_at='2023-11-14T18:08:23.018124',shelved_host='user',shelved_image_id='f70d6c66-4bd0-4263-ae3f-b013b3118fd6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:08:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=30f22af1-c024-4da6-bf55-7fba565bd50b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG os_vif [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3148c108-da, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2bfa4b0-59c8-498a-a375-809adf52b0f2) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-0dff4189-04a0-49c7-9714-f06502a0ff6d req-81092ff4-521b-4d19-bb65-afe825897d11 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-changed-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-0dff4189-04a0-49c7-9714-f06502a0ff6d req-81092ff4-521b-4d19-bb65-afe825897d11 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Refreshing instance network info cache due to event network-changed-3148c108-daab-4928-8c8c-35ed2c11a9bc. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0dff4189-04a0-49c7-9714-f06502a0ff6d req-81092ff4-521b-4d19-bb65-afe825897d11 service nova] Acquiring lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0dff4189-04a0-49c7-9714-f06502a0ff6d req-81092ff4-521b-4d19-bb65-afe825897d11 service nova] Acquired lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.network.neutron [req-0dff4189-04a0-49c7-9714-f06502a0ff6d req-81092ff4-521b-4d19-bb65-afe825897d11 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Refreshing network info cache for port 3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:08:24 user nova-compute[76161]: INFO os_vif [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da')
Nov 14 18:08:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Deleting instance files /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b_del
Nov 14 18:08:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Deletion of /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b_del complete
Nov 14 18:08:24 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Deleted allocations for instance 30f22af1-c024-4da6-bf55-7fba565bd50b
Nov 14 18:08:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'numa_topology' on Instance uuid 30f22af1-c024-4da6-bf55-7fba565bd50b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.objects.base [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Object Instance<30f22af1-c024-4da6-bf55-7fba565bd50b> lazy-loaded attributes: resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.network.neutron [req-0dff4189-04a0-49c7-9714-f06502a0ff6d req-81092ff4-521b-4d19-bb65-afe825897d11 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updated VIF entry in instance network info cache for port 3148c108-daab-4928-8c8c-35ed2c11a9bc. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.network.neutron [req-0dff4189-04a0-49c7-9714-f06502a0ff6d req-81092ff4-521b-4d19-bb65-afe825897d11 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updating instance_info_cache with network_info: [{"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3148c108-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0dff4189-04a0-49c7-9714-f06502a0ff6d req-81092ff4-521b-4d19-bb65-afe825897d11 service nova] Releasing lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d035d58c-100d-4ce3-a240-473719ca2062 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.050s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:08:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:08:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:30 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:08:30 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:08:30 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=7930MB free_disk=25.06142807006836GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:08:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0ec5fe2-517b-498c-8606-9417432c8803 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e4f6135c-879b-4a15-8798-b6d83e5823da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 3a02e8f0-7228-4dde-8c34-55a94356362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 0413997a-4ae9-4b6e-8571-6e2174d7f105 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:08:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:33 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:08:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:54 user nova-compute[76161]: INFO nova.compute.manager [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Terminating instance
Nov 14 18:08:54 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-dc709b2d-0939-411b-9f78-23a1a1000947 req-5da17347-71b4-4ebe-880d-5acbaa4f20ff service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Received event network-vif-unplugged-f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dc709b2d-0939-411b-9f78-23a1a1000947 req-5da17347-71b4-4ebe-880d-5acbaa4f20ff service nova] Acquiring lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dc709b2d-0939-411b-9f78-23a1a1000947 req-5da17347-71b4-4ebe-880d-5acbaa4f20ff service nova] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dc709b2d-0939-411b-9f78-23a1a1000947 req-5da17347-71b4-4ebe-880d-5acbaa4f20ff service nova] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-dc709b2d-0939-411b-9f78-23a1a1000947 req-5da17347-71b4-4ebe-880d-5acbaa4f20ff service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] No waiting events found dispatching network-vif-unplugged-f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-dc709b2d-0939-411b-9f78-23a1a1000947 req-5da17347-71b4-4ebe-880d-5acbaa4f20ff service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Received event network-vif-unplugged-f023f734-0b61-461c-b3ab-100bcf5706b6 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Instance destroyed successfully.
Nov 14 18:08:54 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lazy-loading 'resources' on Instance uuid bed4f7a2-be4f-4c3a-a925-4c8b65105fb0 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2089056756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2089056756',id=1,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69696059b86f44b7ae274bf8274f9843',ramdisk_id='',reservation_id='r-cfswyfga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-500586355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:51:12Z,user_data=None,user_id='4714975d06d8455788463a30e9bc5faa',uuid=bed4f7a2-be4f-4c3a-a925-4c8b65105fb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converting VIF {"id": "f023f734-0b61-461c-b3ab-100bcf5706b6", "address": "fa:16:3e:f4:e1:31", "network": {"id": "931a4ac5-70ac-46bd-806e-8d306eab9091", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1997993730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69696059b86f44b7ae274bf8274f9843", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf023f734-0b", "ovs_interfaceid": "f023f734-0b61-461c-b3ab-100bcf5706b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=f023f734-0b61-461c-b3ab-100bcf5706b6,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023f734-0b') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG os_vif [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=f023f734-0b61-461c-b3ab-100bcf5706b6,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023f734-0b') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf023f734-0b, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f1d8e3e-d7cd-4427-b874-c82dd1391dca) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:08:54 user nova-compute[76161]: INFO os_vif [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=f023f734-0b61-461c-b3ab-100bcf5706b6,network=Network(931a4ac5-70ac-46bd-806e-8d306eab9091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf023f734-0b')
Nov 14 18:08:54 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Deleting instance files /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0_del
Nov 14 18:08:54 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Deletion of /opt/stack/data/nova/instances/bed4f7a2-be4f-4c3a-a925-4c8b65105fb0_del complete
Nov 14 18:08:54 user nova-compute[76161]: INFO nova.compute.manager [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 18:08:54 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:08:54 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:08:55 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:08:55 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Took 0.43 seconds to deallocate network for instance.
Nov 14 18:08:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:55 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:08:55 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:08:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:55 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Deleted allocations for instance bed4f7a2-be4f-4c3a-a925-4c8b65105fb0
Nov 14 18:08:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e6f15361-4023-4159-b39c-2ccd830cdd89 tempest-ServerBootFromVolumeStableRescueTest-500586355 tempest-ServerBootFromVolumeStableRescueTest-500586355-project-member] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.735s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-566f74be-04ff-4aa8-a74b-4c50f233b772 req-9e0a1c22-3b34-4983-a1fa-7507313b6544 service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Received event network-vif-plugged-f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-566f74be-04ff-4aa8-a74b-4c50f233b772 req-9e0a1c22-3b34-4983-a1fa-7507313b6544 service nova] Acquiring lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:08:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-566f74be-04ff-4aa8-a74b-4c50f233b772 req-9e0a1c22-3b34-4983-a1fa-7507313b6544 service nova] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:08:56 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-566f74be-04ff-4aa8-a74b-4c50f233b772 req-9e0a1c22-3b34-4983-a1fa-7507313b6544 service nova] Lock "bed4f7a2-be4f-4c3a-a925-4c8b65105fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:08:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-566f74be-04ff-4aa8-a74b-4c50f233b772 req-9e0a1c22-3b34-4983-a1fa-7507313b6544 service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] No waiting events found dispatching network-vif-plugged-f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:08:56 user nova-compute[76161]: WARNING nova.compute.manager [req-566f74be-04ff-4aa8-a74b-4c50f233b772 req-9e0a1c22-3b34-4983-a1fa-7507313b6544 service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Received unexpected event network-vif-plugged-f023f734-0b61-461c-b3ab-100bcf5706b6 for instance with vm_state deleted and task_state None.
Nov 14 18:08:56 user nova-compute[76161]: DEBUG nova.compute.manager [req-566f74be-04ff-4aa8-a74b-4c50f233b772 req-9e0a1c22-3b34-4983-a1fa-7507313b6544 service nova] [instance: bed4f7a2-be4f-4c3a-a925-4c8b65105fb0] Received event network-vif-deleted-f023f734-0b61-461c-b3ab-100bcf5706b6 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:08:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:09:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:09:20 user nova-compute[76161]: INFO nova.compute.claims [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Claim successful on node user
Nov 14 18:09:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:09:20 user nova-compute[76161]: DEBUG nova.network.neutron [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:09:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:09:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:09:21 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Creating image(s)
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG nova.policy [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b58cf52433541ff9230d5d7a5944c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a6f01a49a45df9ce7c8bb72fe09aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.192s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.190s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk 1073741824" returned: 0 in 0.048s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG nova.network.neutron [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Successfully created port: 99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Cannot resize image /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Ensure instance console log exists: /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Successfully updated port: 99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:09:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:09:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquired lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:09:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:09:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-5283a5ae-cca8-4961-a5ce-df93bac01bff req-60717f84-f581-4bf4-bba2-f4ff6173edb1 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-changed-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-5283a5ae-cca8-4961-a5ce-df93bac01bff req-60717f84-f581-4bf4-bba2-f4ff6173edb1 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Refreshing instance network info cache due to event network-changed-99e841f1-c43d-40dc-9376-8f64d20e4f15. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:09:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5283a5ae-cca8-4961-a5ce-df93bac01bff req-60717f84-f581-4bf4-bba2-f4ff6173edb1 service nova] Acquiring lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:09:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updating instance_info_cache with network_info: [{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Releasing lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Instance network_info: |[{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5283a5ae-cca8-4961-a5ce-df93bac01bff req-60717f84-f581-4bf4-bba2-f4ff6173edb1 service nova] Acquired lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-5283a5ae-cca8-4961-a5ce-df93bac01bff req-60717f84-f581-4bf4-bba2-f4ff6173edb1 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Refreshing network info cache for port 99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Start _get_guest_xml network_info=[{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:09:23 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:09:23 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-196351056',display_name='tempest-ServerStableDeviceRescueTest-server-196351056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-196351056',id=44,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77XaCIngo1th53padje9DsAhl9KOSKNZfZjKECok4W8bntCT4mMyM8EyF0mqq2RPfflzegwryBnKJf/5p1N/fK3vrUfhE2263FFBur2SdR/bJMZXl3/2cEbUtkm0HM/A==',key_name='tempest-keypair-1640878755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd8a6f01a49a45df9ce7c8bb72fe09aa',ramdisk_id='',reservation_id='r-9p4i9zht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-888944149',owner_user_name='tempest-ServerStableDeviceRescueTest-888944149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b58cf52433541ff9230d5d7a5944c40',uuid=3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Converting VIF {"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:c6:04,bridge_name='br-int',has_traffic_filtering=True,id=99e841f1-c43d-40dc-9376-8f64d20e4f15,network=Network(3e50900b-d50a-4af2-9e2a-b4be58b96dd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99e841f1-c4') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.objects.instance [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:09:23 user nova-compute[76161]:   <uuid>3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98</uuid>
Nov 14 18:09:23 user nova-compute[76161]:   <name>instance-0000002c</name>
Nov 14 18:09:23 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:09:23 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:09:23 user nova-compute[76161]:   <metadata>
Nov 14 18:09:23 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:09:23 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:09:23 user nova-compute[76161]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-196351056</nova:name>
Nov 14 18:09:23 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:09:23</nova:creationTime>
Nov 14 18:09:23 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:09:23 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:09:23 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:09:23 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:09:23 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:09:23 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:09:23 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:09:23 user nova-compute[76161]:       <nova:owner>
Nov 14 18:09:23 user nova-compute[76161]:         <nova:user uuid="6b58cf52433541ff9230d5d7a5944c40">tempest-ServerStableDeviceRescueTest-888944149-project-member</nova:user>
Nov 14 18:09:23 user nova-compute[76161]:         <nova:project uuid="bd8a6f01a49a45df9ce7c8bb72fe09aa">tempest-ServerStableDeviceRescueTest-888944149</nova:project>
Nov 14 18:09:23 user nova-compute[76161]:       </nova:owner>
Nov 14 18:09:23 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:09:23 user nova-compute[76161]:       <nova:ports>
Nov 14 18:09:23 user nova-compute[76161]:         <nova:port uuid="99e841f1-c43d-40dc-9376-8f64d20e4f15">
Nov 14 18:09:23 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 18:09:23 user nova-compute[76161]:         </nova:port>
Nov 14 18:09:23 user nova-compute[76161]:       </nova:ports>
Nov 14 18:09:23 user nova-compute[76161]:     </nova:instance>
Nov 14 18:09:23 user nova-compute[76161]:   </metadata>
Nov 14 18:09:23 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:09:23 user nova-compute[76161]:     <system>
Nov 14 18:09:23 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:09:23 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:09:23 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:09:23 user nova-compute[76161]:       <entry name="serial">3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98</entry>
Nov 14 18:09:23 user nova-compute[76161]:       <entry name="uuid">3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98</entry>
Nov 14 18:09:23 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:09:23 user nova-compute[76161]:     </system>
Nov 14 18:09:23 user nova-compute[76161]:   </sysinfo>
Nov 14 18:09:23 user nova-compute[76161]:   <os>
Nov 14 18:09:23 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:09:23 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:09:23 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:09:23 user nova-compute[76161]:   </os>
Nov 14 18:09:23 user nova-compute[76161]:   <features>
Nov 14 18:09:23 user nova-compute[76161]:     <acpi/>
Nov 14 18:09:23 user nova-compute[76161]:     <apic/>
Nov 14 18:09:23 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:09:23 user nova-compute[76161]:   </features>
Nov 14 18:09:23 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:09:23 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:09:23 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:09:23 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:09:23 user nova-compute[76161]:   </clock>
Nov 14 18:09:23 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:09:23 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:09:23 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:09:23 user nova-compute[76161]:   </cpu>
Nov 14 18:09:23 user nova-compute[76161]:   <devices>
Nov 14 18:09:23 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:09:23 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:09:23 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk"/>
Nov 14 18:09:23 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:09:23 user nova-compute[76161]:     </disk>
Nov 14 18:09:23 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:09:23 user nova-compute[76161]:       <mac address="fa:16:3e:42:c6:04"/>
Nov 14 18:09:23 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:09:23 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:09:23 user nova-compute[76161]:       <target dev="tap99e841f1-c4"/>
Nov 14 18:09:23 user nova-compute[76161]:     </interface>
Nov 14 18:09:23 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:09:23 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/console.log" append="off"/>
Nov 14 18:09:23 user nova-compute[76161]:     </serial>
Nov 14 18:09:23 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:09:23 user nova-compute[76161]:     <video>
Nov 14 18:09:23 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:09:23 user nova-compute[76161]:     </video>
Nov 14 18:09:23 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:09:23 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:09:23 user nova-compute[76161]:     </rng>
Nov 14 18:09:23 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:09:23 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:09:23 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:09:23 user nova-compute[76161]:     </memballoon>
Nov 14 18:09:23 user nova-compute[76161]:   </devices>
Nov 14 18:09:23 user nova-compute[76161]: </domain>
Nov 14 18:09:23 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-196351056',display_name='tempest-ServerStableDeviceRescueTest-server-196351056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-196351056',id=44,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77XaCIngo1th53padje9DsAhl9KOSKNZfZjKECok4W8bntCT4mMyM8EyF0mqq2RPfflzegwryBnKJf/5p1N/fK3vrUfhE2263FFBur2SdR/bJMZXl3/2cEbUtkm0HM/A==',key_name='tempest-keypair-1640878755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd8a6f01a49a45df9ce7c8bb72fe09aa',ramdisk_id='',reservation_id='r-9p4i9zht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-888944149',owner_user_name='tempest-ServerStableDeviceRescueTest-888944149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b58cf52433541ff9230d5d7a5944c40',uuid=3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Converting VIF {"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:c6:04,bridge_name='br-int',has_traffic_filtering=True,id=99e841f1-c43d-40dc-9376-8f64d20e4f15,network=Network(3e50900b-d50a-4af2-9e2a-b4be58b96dd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99e841f1-c4') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG os_vif [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:c6:04,bridge_name='br-int',has_traffic_filtering=True,id=99e841f1-c43d-40dc-9376-8f64d20e4f15,network=Network(3e50900b-d50a-4af2-9e2a-b4be58b96dd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99e841f1-c4') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcf3a398-7632-5e77-ad52-bdc2af5b2148', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99e841f1-c4, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99e841f1-c4, col_values=(('qos', UUID('2f056002-3c74-43dd-844d-ed64f2788cd6')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99e841f1-c4, col_values=(('external_ids', {'iface-id': '99e841f1-c43d-40dc-9376-8f64d20e4f15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:c6:04', 'vm-uuid': '3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:09:23 user nova-compute[76161]: INFO os_vif [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:c6:04,bridge_name='br-int',has_traffic_filtering=True,id=99e841f1-c43d-40dc-9376-8f64d20e4f15,network=Network(3e50900b-d50a-4af2-9e2a-b4be58b96dd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99e841f1-c4')
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] No VIF found with MAC fa:16:3e:42:c6:04, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-5283a5ae-cca8-4961-a5ce-df93bac01bff req-60717f84-f581-4bf4-bba2-f4ff6173edb1 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updated VIF entry in instance network info cache for port 99e841f1-c43d-40dc-9376-8f64d20e4f15. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-5283a5ae-cca8-4961-a5ce-df93bac01bff req-60717f84-f581-4bf4-bba2-f4ff6173edb1 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updating instance_info_cache with network_info: [{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5283a5ae-cca8-4961-a5ce-df93bac01bff req-60717f84-f581-4bf4-bba2-f4ff6173edb1 service nova] Releasing lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-55283c7c-af2c-4b89-8cc6-98cfddc278ea req-9f146d41-74d0-4da2-997c-a3fef13f8ba5 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-changed-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-55283c7c-af2c-4b89-8cc6-98cfddc278ea req-9f146d41-74d0-4da2-997c-a3fef13f8ba5 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Refreshing instance network info cache due to event network-changed-5296e396-4864-4119-a35b-bc4eb12284c1. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-55283c7c-af2c-4b89-8cc6-98cfddc278ea req-9f146d41-74d0-4da2-997c-a3fef13f8ba5 service nova] Acquiring lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-55283c7c-af2c-4b89-8cc6-98cfddc278ea req-9f146d41-74d0-4da2-997c-a3fef13f8ba5 service nova] Acquired lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:09:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-55283c7c-af2c-4b89-8cc6-98cfddc278ea req-9f146d41-74d0-4da2-997c-a3fef13f8ba5 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Refreshing network info cache for port 5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'flavor' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG nova.network.neutron [req-55283c7c-af2c-4b89-8cc6-98cfddc278ea req-9f146d41-74d0-4da2-997c-a3fef13f8ba5 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updated VIF entry in instance network info cache for port 5296e396-4864-4119-a35b-bc4eb12284c1. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG nova.network.neutron [req-55283c7c-af2c-4b89-8cc6-98cfddc278ea req-9f146d41-74d0-4da2-997c-a3fef13f8ba5 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updating instance_info_cache with network_info: [{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-55283c7c-af2c-4b89-8cc6-98cfddc278ea req-9f146d41-74d0-4da2-997c-a3fef13f8ba5 service nova] Releasing lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:24 user nova-compute[76161]: INFO nova.compute.manager [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Attaching volume 0b7d20d7-67ad-42ab-a871-c570f1d91e6b to /dev/vdb
Nov 14 18:09:24 user nova-compute[76161]: DEBUG os_brick.utils [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[68552b2d-a79b-42b6-8e24-4cbaadfd0771]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c47ac-667c-4a3e-a572-49456ba8ce8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35d2c5f-fe88-48c8-8e38-b6e1d1aa7370]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfce0201-2b28-4dd8-8d1d-01e5eb7505d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:09:24 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed28b10d-676b-4691-90ac-5734624575ad]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG os_brick.utils [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updating existing volume attachment record: 5cc3975d-9dd7-4558-bcde-f3d2b219b78e {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-3971af80-a922-4b05-8bb1-23d8d74cfc29 req-5b67ebe4-52e2-46a4-a118-189749913c0a service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3971af80-a922-4b05-8bb1-23d8d74cfc29 req-5b67ebe4-52e2-46a4-a118-189749913c0a service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3971af80-a922-4b05-8bb1-23d8d74cfc29 req-5b67ebe4-52e2-46a4-a118-189749913c0a service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3971af80-a922-4b05-8bb1-23d8d74cfc29 req-5b67ebe4-52e2-46a4-a118-189749913c0a service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-3971af80-a922-4b05-8bb1-23d8d74cfc29 req-5b67ebe4-52e2-46a4-a118-189749913c0a service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:09:24 user nova-compute[76161]: WARNING nova.compute.manager [req-3971af80-a922-4b05-8bb1-23d8d74cfc29 req-5b67ebe4-52e2-46a4-a118-189749913c0a service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state building and task_state spawning.
Nov 14 18:09:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:09:26 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Instance spawned successfully.
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-26084975-a8b4-4b9c-8591-960f92cd6021 req-d0999bf4-9053-49b3-a47a-026d8fb883de service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-26084975-a8b4-4b9c-8591-960f92cd6021 req-d0999bf4-9053-49b3-a47a-026d8fb883de service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-26084975-a8b4-4b9c-8591-960f92cd6021 req-d0999bf4-9053-49b3-a47a-026d8fb883de service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-26084975-a8b4-4b9c-8591-960f92cd6021 req-d0999bf4-9053-49b3-a47a-026d8fb883de service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-26084975-a8b4-4b9c-8591-960f92cd6021 req-d0999bf4-9053-49b3-a47a-026d8fb883de service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:09:26 user nova-compute[76161]: WARNING nova.compute.manager [req-26084975-a8b4-4b9c-8591-960f92cd6021 req-d0999bf4-9053-49b3-a47a-026d8fb883de service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state building and task_state spawning.
Nov 14 18:09:26 user nova-compute[76161]: INFO nova.compute.manager [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 14 18:09:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:09:27 user nova-compute[76161]: INFO nova.compute.manager [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Took 6.63 seconds to build instance.
Nov 14 18:09:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-be675e28-460b-4b23-90d7-3c9446cea7b8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.727s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGWfuLXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:09:29 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:09:29 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:09:29 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b07015-78ae-47a5-84fe-2be41d80057d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:09:29 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[41090ee8-9aa3-475d-a463-77e3c3692975]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b] added
Nov 14 18:09:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9831fb-de2e-493d-9dfb-5e1c180e697e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4142031-3878-45d3-8cc7-268ce4cf183f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGWfuLXj {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGWfuLXj" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8557e2a9-c176-4167-b0bc-68f40345ac44]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qGWfuLXj'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[668128eb-eac4-4c6c-9774-da844279bd26]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab41f5b9-bc18-4035-bd96-9a563dc9b61a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:29 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:09:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:29 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:09:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c36c585-967f-433d-bb64-6455e2b6a4f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b, portal: 172.16.0.220,3260]
Nov 14 18:09:29 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b, portal: 172.16.0.220,3260] successful.
Nov 14 18:09:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a39b7ca-09c1-4f99-96ab-ccf363fc4f7e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[be928b28-77d8-4648-8474-107a7e5c9536]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:29 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:09:29 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:29 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:09:29 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[941ceb4d-2dbc-4c77-8cc6-f18be8af014b]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:09:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGWfuLXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23462363033316330', 'path': '/dev/sdd'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462363033316330', 'path': '/dev/sdd'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG nova.objects.instance [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'flavor' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:09:30 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:09:30 user nova-compute[76161]:   <source dev="/dev/sdd"/>
Nov 14 18:09:30 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:09:30 user nova-compute[76161]:   <serial>0b7d20d7-67ad-42ab-a871-c570f1d91e6b</serial>
Nov 14 18:09:30 user nova-compute[76161]: </disk>
Nov 14 18:09:30 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No VIF found with MAC fa:16:3e:38:8a:b9, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-2fb3d811-5363-4f25-8ad9-182eb41b411b tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.853s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:32 user nova-compute[76161]: INFO nova.compute.manager [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Rescuing
Nov 14 18:09:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:09:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquired lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:09:32 user nova-compute[76161]: DEBUG nova.network.neutron [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:09:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:33 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:09:33 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8165MB free_disk=25.175796508789062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0ec5fe2-517b-498c-8606-9417432c8803 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e4f6135c-879b-4a15-8798-b6d83e5823da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 3a02e8f0-7228-4dde-8c34-55a94356362c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 0413997a-4ae9-4b6e-8571-6e2174d7f105 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.network.neutron [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updating instance_info_cache with network_info: [{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Releasing lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-505da5de-48e5-4854-a313-3ea043016fa6 req-36d520c3-fea8-41af-8337-fa413bd8f20e service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-505da5de-48e5-4854-a313-3ea043016fa6 req-36d520c3-fea8-41af-8337-fa413bd8f20e service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-505da5de-48e5-4854-a313-3ea043016fa6 req-36d520c3-fea8-41af-8337-fa413bd8f20e service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-505da5de-48e5-4854-a313-3ea043016fa6 req-36d520c3-fea8-41af-8337-fa413bd8f20e service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-505da5de-48e5-4854-a313-3ea043016fa6 req-36d520c3-fea8-41af-8337-fa413bd8f20e service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:09:33 user nova-compute[76161]: WARNING nova.compute.manager [req-505da5de-48e5-4854-a313-3ea043016fa6 req-36d520c3-fea8-41af-8337-fa413bd8f20e service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state active and task_state rescuing.
Nov 14 18:09:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Instance destroyed successfully.
Nov 14 18:09:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Attempting rescue
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76161) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Instance directory exists: not creating {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 18:09:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Creating image(s)
Nov 14 18:09:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.rescue {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.rescue" returned: 0 in 0.053s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'migration_context' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.base [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<e4f6135c-879b-4a15-8798-b6d83e5823da> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Start _get_guest_xml network_info=[{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "vif_mac": "fa:16:3e:38:8a:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'resources' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.base [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<e4f6135c-879b-4a15-8798-b6d83e5823da> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'numa_topology' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.base [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<e4f6135c-879b-4a15-8798-b6d83e5823da> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:09:34 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:09:34 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.base [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<e4f6135c-879b-4a15-8798-b6d83e5823da> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1076990849',display_name='tempest-ServerRescueNegativeTestJSON-server-1076990849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1076990849',id=41,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBeZoRV3kMXn/GA46eMNNcJ0tRZceNHh7TAIS5rF1neUcM4S6sNuRCXF0QtpQeXfc7hMCS+WkohSV8NcLF0hT2hw1cucJ9T0krp596vdpHjZgIxTbNUVRRJKYsl61TLWA==',key_name='tempest-keypair-719486534',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:07:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-puohjd9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=e4f6135c-879b-4a15-8798-b6d83e5823da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "vif_mac": "fa:16:3e:38:8a:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "vif_mac": "fa:16:3e:38:8a:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:8a:b9,bridge_name='br-int',has_traffic_filtering=True,id=5296e396-4864-4119-a35b-bc4eb12284c1,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296e396-48') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'pci_devices' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.objects.base [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Object Instance<e4f6135c-879b-4a15-8798-b6d83e5823da> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:09:34 user nova-compute[76161]:   <uuid>e4f6135c-879b-4a15-8798-b6d83e5823da</uuid>
Nov 14 18:09:34 user nova-compute[76161]:   <name>instance-00000029</name>
Nov 14 18:09:34 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:09:34 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:09:34 user nova-compute[76161]:   <metadata>
Nov 14 18:09:34 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:09:34 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:09:34 user nova-compute[76161]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1076990849</nova:name>
Nov 14 18:09:34 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:09:34</nova:creationTime>
Nov 14 18:09:34 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:09:34 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:09:34 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:09:34 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:09:34 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:09:34 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:09:34 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:09:34 user nova-compute[76161]:       <nova:owner>
Nov 14 18:09:34 user nova-compute[76161]:         <nova:user uuid="d463f3fddeba4976bded6ba5abc6c98c">tempest-ServerRescueNegativeTestJSON-1787067728-project-member</nova:user>
Nov 14 18:09:34 user nova-compute[76161]:         <nova:project uuid="952a823fe4e04963916979f78d5c82a7">tempest-ServerRescueNegativeTestJSON-1787067728</nova:project>
Nov 14 18:09:34 user nova-compute[76161]:       </nova:owner>
Nov 14 18:09:34 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:09:34 user nova-compute[76161]:       <nova:ports>
Nov 14 18:09:34 user nova-compute[76161]:         <nova:port uuid="5296e396-4864-4119-a35b-bc4eb12284c1">
Nov 14 18:09:34 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 18:09:34 user nova-compute[76161]:         </nova:port>
Nov 14 18:09:34 user nova-compute[76161]:       </nova:ports>
Nov 14 18:09:34 user nova-compute[76161]:     </nova:instance>
Nov 14 18:09:34 user nova-compute[76161]:   </metadata>
Nov 14 18:09:34 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:09:34 user nova-compute[76161]:     <system>
Nov 14 18:09:34 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:09:34 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:09:34 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:09:34 user nova-compute[76161]:       <entry name="serial">e4f6135c-879b-4a15-8798-b6d83e5823da</entry>
Nov 14 18:09:34 user nova-compute[76161]:       <entry name="uuid">e4f6135c-879b-4a15-8798-b6d83e5823da</entry>
Nov 14 18:09:34 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:09:34 user nova-compute[76161]:     </system>
Nov 14 18:09:34 user nova-compute[76161]:   </sysinfo>
Nov 14 18:09:34 user nova-compute[76161]:   <os>
Nov 14 18:09:34 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:09:34 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:09:34 user nova-compute[76161]:   </os>
Nov 14 18:09:34 user nova-compute[76161]:   <features>
Nov 14 18:09:34 user nova-compute[76161]:     <acpi/>
Nov 14 18:09:34 user nova-compute[76161]:     <apic/>
Nov 14 18:09:34 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:09:34 user nova-compute[76161]:   </features>
Nov 14 18:09:34 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:09:34 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:09:34 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:09:34 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:09:34 user nova-compute[76161]:   </clock>
Nov 14 18:09:34 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:09:34 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:09:34 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:09:34 user nova-compute[76161]:   </cpu>
Nov 14 18:09:34 user nova-compute[76161]:   <devices>
Nov 14 18:09:34 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:09:34 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:09:34 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.rescue"/>
Nov 14 18:09:34 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:09:34 user nova-compute[76161]:     </disk>
Nov 14 18:09:34 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:09:34 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:09:34 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk"/>
Nov 14 18:09:34 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 18:09:34 user nova-compute[76161]:     </disk>
Nov 14 18:09:34 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:09:34 user nova-compute[76161]:       <mac address="fa:16:3e:38:8a:b9"/>
Nov 14 18:09:34 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:09:34 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:09:34 user nova-compute[76161]:       <target dev="tap5296e396-48"/>
Nov 14 18:09:34 user nova-compute[76161]:     </interface>
Nov 14 18:09:34 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:09:34 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/console.log" append="off"/>
Nov 14 18:09:34 user nova-compute[76161]:     </serial>
Nov 14 18:09:34 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:09:34 user nova-compute[76161]:     <video>
Nov 14 18:09:34 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:09:34 user nova-compute[76161]:     </video>
Nov 14 18:09:34 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:09:34 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:09:34 user nova-compute[76161]:     </rng>
Nov 14 18:09:34 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:09:34 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:09:34 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:09:34 user nova-compute[76161]:     </memballoon>
Nov 14 18:09:34 user nova-compute[76161]:   </devices>
Nov 14 18:09:34 user nova-compute[76161]: </domain>
Nov 14 18:09:34 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:09:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Instance destroyed successfully.
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:09:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] No VIF found with MAC fa:16:3e:38:8a:b9, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:09:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-3cc576dc-4ec6-4c77-a8d7-3560107a8f24 req-9a6067bc-85ee-4881-b849-7ff2341f64cc service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3cc576dc-4ec6-4c77-a8d7-3560107a8f24 req-9a6067bc-85ee-4881-b849-7ff2341f64cc service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3cc576dc-4ec6-4c77-a8d7-3560107a8f24 req-9a6067bc-85ee-4881-b849-7ff2341f64cc service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3cc576dc-4ec6-4c77-a8d7-3560107a8f24 req-9a6067bc-85ee-4881-b849-7ff2341f64cc service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-3cc576dc-4ec6-4c77-a8d7-3560107a8f24 req-9a6067bc-85ee-4881-b849-7ff2341f64cc service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:09:35 user nova-compute[76161]: WARNING nova.compute.manager [req-3cc576dc-4ec6-4c77-a8d7-3560107a8f24 req-9a6067bc-85ee-4881-b849-7ff2341f64cc service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state active and task_state rescuing.
Nov 14 18:09:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:09:37 user nova-compute[76161]: WARNING nova.compute.manager [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state active and task_state rescuing.
Nov 14 18:09:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:09:37 user nova-compute[76161]: WARNING nova.compute.manager [req-6b8756c9-32bb-404f-9b7c-3a8843f7feb5 req-dbe0d9de-e6ee-4c09-a217-815c1843fab9 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state active and task_state rescuing.
Nov 14 18:09:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ed10857e-d0cc-48c8-84bb-f9b513d6cd16 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:09:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-f6de02d6-b4da-4284-87d5-b45f5fd45f84 req-ffc22bad-4069-4b19-924d-d62a2c303318 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received event network-changed-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:42 user nova-compute[76161]: DEBUG nova.compute.manager [req-f6de02d6-b4da-4284-87d5-b45f5fd45f84 req-ffc22bad-4069-4b19-924d-d62a2c303318 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Refreshing instance network info cache due to event network-changed-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:09:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f6de02d6-b4da-4284-87d5-b45f5fd45f84 req-ffc22bad-4069-4b19-924d-d62a2c303318 service nova] Acquiring lock "refresh_cache-3a02e8f0-7228-4dde-8c34-55a94356362c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:09:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f6de02d6-b4da-4284-87d5-b45f5fd45f84 req-ffc22bad-4069-4b19-924d-d62a2c303318 service nova] Acquired lock "refresh_cache-3a02e8f0-7228-4dde-8c34-55a94356362c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:09:42 user nova-compute[76161]: DEBUG nova.network.neutron [req-f6de02d6-b4da-4284-87d5-b45f5fd45f84 req-ffc22bad-4069-4b19-924d-d62a2c303318 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Refreshing network info cache for port 7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:09:42 user nova-compute[76161]: DEBUG nova.network.neutron [req-f6de02d6-b4da-4284-87d5-b45f5fd45f84 req-ffc22bad-4069-4b19-924d-d62a2c303318 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Updated VIF entry in instance network info cache for port 7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:09:42 user nova-compute[76161]: DEBUG nova.network.neutron [req-f6de02d6-b4da-4284-87d5-b45f5fd45f84 req-ffc22bad-4069-4b19-924d-d62a2c303318 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Updating instance_info_cache with network_info: [{"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:09:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f6de02d6-b4da-4284-87d5-b45f5fd45f84 req-ffc22bad-4069-4b19-924d-d62a2c303318 service nova] Releasing lock "refresh_cache-3a02e8f0-7228-4dde-8c34-55a94356362c" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:09:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG nova.objects.instance [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 3a02e8f0-7228-4dde-8c34-55a94356362c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:44 user nova-compute[76161]: INFO nova.compute.manager [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Attaching volume 2709a11f-f14b-43e8-9279-48df16bb9cd3 to /dev/vdb
Nov 14 18:09:44 user nova-compute[76161]: DEBUG os_brick.utils [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4280f111-d7a1-4d60-b43c-708643f95c69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa378e2-1c15-4d0c-8818-68e2ea999138]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8552cc99-d938-44f2-bfe3-3779e1299732]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6410789c-880b-434a-b77e-cac2413fefc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:09:44 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:09:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e35974-577f-4d58-8843-56ffcdf70558]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG os_brick.utils [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:09:44 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Updating existing volume attachment record: bbb62a13-00f3-49f9-9fed-68438b8e7d0e {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:09:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMxOYdom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:09:49 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:09:49 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:09:49 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a0838c-6542-4213-acfd-4bfebd3feb1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:09:49 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44b2630-90f1-4be2-852b-97689720b7f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3] added
Nov 14 18:09:49 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e521bf3-8abe-4d51-b0dd-11d66d26afc0]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b17a62-5039-4076-90e4-ddc14d3de1d5]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMxOYdom {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMxOYdom" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a4bb5b-9bdf-4689-b179-e8a67582ac4c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pMxOYdom'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc319f1-2000-46ca-99f3-8e1abade4247]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16f9a1c-cf33-4391-9e75-beb5867008b0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:49 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:09:49 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:49 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:49 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:09:49 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:49 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[29093602-fda0-44bb-9523-499afc266c0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3, portal: 172.16.0.220,3260]
Nov 14 18:09:49 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3, portal: 172.16.0.220,3260] successful.
Nov 14 18:09:49 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4664e5de-d385-4134-8321-811967e3f38c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d559bef2-140e-46ce-b9d0-9e11cae24a99]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:49 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:09:49 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:49 user nova-compute[76161]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)
Nov 14 18:09:49 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:49 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:09:49 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:49 user nova-compute[76161]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)
Nov 14 18:09:49 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f195a9-bdee-4123-b6a2-99753928d620]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:09:49 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMxOYdom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23537653063366138', 'path': '/dev/sde'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537653063366138', 'path': '/dev/sde'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG nova.objects.instance [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 3a02e8f0-7228-4dde-8c34-55a94356362c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:09:50 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:09:50 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:09:50 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:09:50 user nova-compute[76161]:   <serial>2709a11f-f14b-43e8-9279-48df16bb9cd3</serial>
Nov 14 18:09:50 user nova-compute[76161]: </disk>
Nov 14 18:09:50 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-5150ff4a-8b28-4abd-a810-9d2204d279e3 req-9ff2e740-3730-48be-af9d-6c7ec92a610c service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received event network-changed-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-5150ff4a-8b28-4abd-a810-9d2204d279e3 req-9ff2e740-3730-48be-af9d-6c7ec92a610c service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Refreshing instance network info cache due to event network-changed-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5150ff4a-8b28-4abd-a810-9d2204d279e3 req-9ff2e740-3730-48be-af9d-6c7ec92a610c service nova] Acquiring lock "refresh_cache-0413997a-4ae9-4b6e-8571-6e2174d7f105" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5150ff4a-8b28-4abd-a810-9d2204d279e3 req-9ff2e740-3730-48be-af9d-6c7ec92a610c service nova] Acquired lock "refresh_cache-0413997a-4ae9-4b6e-8571-6e2174d7f105" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG nova.network.neutron [req-5150ff4a-8b28-4abd-a810-9d2204d279e3 req-9ff2e740-3730-48be-af9d-6c7ec92a610c service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Refreshing network info cache for port 57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:09:50 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No VIF found with MAC fa:16:3e:7b:89:e1, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9011ef59-89b8-42fa-ac6f-650363726ab3 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.828s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-5150ff4a-8b28-4abd-a810-9d2204d279e3 req-9ff2e740-3730-48be-af9d-6c7ec92a610c service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Updated VIF entry in instance network info cache for port 57f5732d-c5a0-4e2c-81b8-f34e4cae97a2. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-5150ff4a-8b28-4abd-a810-9d2204d279e3 req-9ff2e740-3730-48be-af9d-6c7ec92a610c service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Updating instance_info_cache with network_info: [{"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5150ff4a-8b28-4abd-a810-9d2204d279e3 req-9ff2e740-3730-48be-af9d-6c7ec92a610c service nova] Releasing lock "refresh_cache-0413997a-4ae9-4b6e-8571-6e2174d7f105" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "0413997a-4ae9-4b6e-8571-6e2174d7f105" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:51 user nova-compute[76161]: INFO nova.compute.manager [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Terminating instance
Nov 14 18:09:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-40647091-021d-4abe-8846-b05c45eda76f req-da198beb-9ffd-4331-9574-1c63b7c9fe6c service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received event network-vif-unplugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-40647091-021d-4abe-8846-b05c45eda76f req-da198beb-9ffd-4331-9574-1c63b7c9fe6c service nova] Acquiring lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-40647091-021d-4abe-8846-b05c45eda76f req-da198beb-9ffd-4331-9574-1c63b7c9fe6c service nova] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-40647091-021d-4abe-8846-b05c45eda76f req-da198beb-9ffd-4331-9574-1c63b7c9fe6c service nova] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-40647091-021d-4abe-8846-b05c45eda76f req-da198beb-9ffd-4331-9574-1c63b7c9fe6c service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] No waiting events found dispatching network-vif-unplugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-40647091-021d-4abe-8846-b05c45eda76f req-da198beb-9ffd-4331-9574-1c63b7c9fe6c service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received event network-vif-unplugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:52 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Instance destroyed successfully.
Nov 14 18:09:52 user nova-compute[76161]: DEBUG nova.objects.instance [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'resources' on Instance uuid 0413997a-4ae9-4b6e-8571-6e2174d7f105 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1266418046',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1266418046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1266418046',id=43,image_ref='8488e486-f2cf-499f-a2bd-03ef1be174ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL44Zk9nIs5KKtEoYejFwRH/28g6JywZg0r63ax6DFaKfNicku1ohPFzArX/DGC+k3VHZyV9Uy261sTzO9cYkGA9Ww5drtqOtZ+9g5IXuXJGslOQkwGBzQYwMPXs2uz4g==',key_name='tempest-keypair-2011080648',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:08:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-rs0pvigd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1727647616',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:08:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=0413997a-4ae9-4b6e-8571-6e2174d7f105,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "address": "fa:16:3e:87:9f:8d", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f5732d-c5", "ovs_interfaceid": "57f5732d-c5a0-4e2c-81b8-f34e4cae97a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:9f:8d,bridge_name='br-int',has_traffic_filtering=True,id=57f5732d-c5a0-4e2c-81b8-f34e4cae97a2,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f5732d-c5') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_vif [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:9f:8d,bridge_name='br-int',has_traffic_filtering=True,id=57f5732d-c5a0-4e2c-81b8-f34e4cae97a2,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f5732d-c5') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57f5732d-c5, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc5648d4-5422-4bda-a5f1-ea4d7c868215) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:09:52 user nova-compute[76161]: INFO os_vif [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:9f:8d,bridge_name='br-int',has_traffic_filtering=True,id=57f5732d-c5a0-4e2c-81b8-f34e4cae97a2,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57f5732d-c5')
Nov 14 18:09:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWxpbBJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:09:52 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b481ed-0757-4e10-8708-e10786c5acf9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:09:52 user nova-compute[76161]: No targets found.
Nov 14 18:09:52 user nova-compute[76161]: iSNS:
Nov 14 18:09:52 user nova-compute[76161]: No targets found.
Nov 14 18:09:52 user nova-compute[76161]: STATIC:
Nov 14 18:09:52 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b
Nov 14 18:09:52 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:09:52 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:09:52 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3
Nov 14 18:09:52 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:09:52 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:09:52 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea
Nov 14 18:09:52 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:09:52 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:09:52 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3
Nov 14 18:09:52 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:09:52 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:09:52 user nova-compute[76161]: FIRMWARE:
Nov 14 18:09:52 user nova-compute[76161]: No targets found.
Nov 14 18:09:52 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:09:52 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:09:52 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafb399d-fe36-4131-903f-9ac10cc7387f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c4700-17b3-4fe1-8cdb-da6efb312b58]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:52 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:09:52 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:52 user nova-compute[76161]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)
Nov 14 18:09:52 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:52 user nova-compute[76161]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 (non-flash)
Nov 14 18:09:52 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:52 user nova-compute[76161]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)
Nov 14 18:09:52 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d07c6710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9afa7b8-39f2-4c77-8b01-0ed56375811a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0b58af-47af-4047-8aa9-c1999710f19d]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7723e5b-1741-49c8-91d8-031e85021265]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34d0d6a-e12d-4b46-b121-6643ad345549]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4e076c-934a-415c-aaf5-3b542257261e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c07eafa-d0f0-4303-8a75-72db57bdbf58]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3, portal: 172.16.0.220,3260]
Nov 14 18:09:52 user nova-compute[76161]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3, portal: 172.16.0.220,3260] successful.
Nov 14 18:09:52 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:760b6962-f868-49f4-af5d-1caf729971e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0845781f-c303-46ce-bf6a-3038cacac68a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== disconnect_volume: return (314ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:09:52 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Deleting instance files /opt/stack/data/nova/instances/0413997a-4ae9-4b6e-8571-6e2174d7f105_del
Nov 14 18:09:52 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Deletion of /opt/stack/data/nova/instances/0413997a-4ae9-4b6e-8571-6e2174d7f105_del complete
Nov 14 18:09:52 user nova-compute[76161]: INFO nova.compute.manager [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 18:09:52 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:09:52 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:09:53 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Took 0.71 seconds to deallocate network for instance.
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG nova.objects.instance [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 3a02e8f0-7228-4dde-8c34-55a94356362c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:53 user nova-compute[76161]: INFO nova.compute.manager [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Attaching volume bdf8d2a0-7415-48a1-bcdd-e94c097fad53 to /dev/vdc
Nov 14 18:09:53 user nova-compute[76161]: DEBUG os_brick.utils [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3545e6-fecc-4847-8174-e1a76e4f7b4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1c9726-a626-48a0-9c99-5da526ede4fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842175c-9da6-4fbb-a533-9ee26e29ad9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edf8d07-cf35-47b5-af86-4c4340fbf3bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-23dec1bb-6c4e-4042-a7b1-6ebbfd8e42ab req-d45174e7-d6b2-4225-9142-c125d51c101a service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received event network-vif-plugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23dec1bb-6c4e-4042-a7b1-6ebbfd8e42ab req-d45174e7-d6b2-4225-9142-c125d51c101a service nova] Acquiring lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23dec1bb-6c4e-4042-a7b1-6ebbfd8e42ab req-d45174e7-d6b2-4225-9142-c125d51c101a service nova] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23dec1bb-6c4e-4042-a7b1-6ebbfd8e42ab req-d45174e7-d6b2-4225-9142-c125d51c101a service nova] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-23dec1bb-6c4e-4042-a7b1-6ebbfd8e42ab req-d45174e7-d6b2-4225-9142-c125d51c101a service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] No waiting events found dispatching network-vif-plugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:09:53 user nova-compute[76161]: WARNING nova.compute.manager [req-23dec1bb-6c4e-4042-a7b1-6ebbfd8e42ab req-d45174e7-d6b2-4225-9142-c125d51c101a service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received unexpected event network-vif-plugged-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 for instance with vm_state active and task_state deleting.
Nov 14 18:09:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-23dec1bb-6c4e-4042-a7b1-6ebbfd8e42ab req-d45174e7-d6b2-4225-9142-c125d51c101a service nova] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Received event network-vif-deleted-57f5732d-c5a0-4e2c-81b8-f34e4cae97a2 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:09:53 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:09:53 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3be13c-5989-4f33-be2a-9ed22644a3a8]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG os_brick.utils [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:09:53 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Updating existing volume attachment record: 077bb596-c34f-4e4c-9e52-541e0e8be028 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:09:54 user nova-compute[76161]: INFO nova.compute.manager [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Took 0.83 seconds to detach 1 volumes for instance.
Nov 14 18:09:54 user nova-compute[76161]: DEBUG nova.compute.manager [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 0413997a-4ae9-4b6e-8571-6e2174d7f105] Deleting volume: 760b6962-f868-49f4-af5d-1caf729971e3 {{(pid=76161) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 18:09:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:09:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:09:54 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:09:54 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:09:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:54 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Deleted allocations for instance 0413997a-4ae9-4b6e-8571-6e2174d7f105
Nov 14 18:09:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-ca45579a-aef7-4e42-b6fc-c622fe1cb107 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "0413997a-4ae9-4b6e-8571-6e2174d7f105" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.294s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:09:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFnWgClR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:09:58 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:09:58 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:09:58 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac26f88-8de5-4a6e-8591-1e3b197fafae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:09:58 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfbabf0-1662-4933-8587-a122c3a5c0b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53] added
Nov 14 18:09:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1c34ff-9c71-4f65-b47c-5cb3e2bb88bf]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a60bd-7125-48d8-ade6-d90d21b23051]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFnWgClR {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFnWgClR" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[52770e25-d132-43d9-b58c-9c1b89d09071]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pFnWgClR'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a9b5fa-8274-4304-9eab-99097980aafd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[350514a1-4fc1-4f19-8ba1-e65b18f063a9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:58 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:58 user nova-compute[76161]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)
Nov 14 18:09:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:58 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:58 user nova-compute[76161]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)
Nov 14 18:09:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82ebbeb-87ff-490f-9ae0-beb1188d92d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53, portal: 172.16.0.220,3260]
Nov 14 18:09:58 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53, portal: 172.16.0.220,3260] successful.
Nov 14 18:09:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec35b696-bd5f-4400-9dff-d7fa48fa5c9f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1565cc26-e204-4f1d-a38e-777a7e0c8ba9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:58 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:58 user nova-compute[76161]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)
Nov 14 18:09:58 user nova-compute[76161]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)
Nov 14 18:09:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:09:58 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:09:58 user nova-compute[76161]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)
Nov 14 18:09:58 user nova-compute[76161]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)
Nov 14 18:09:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2a04d8-fb9b-4531-b7c9-b99a90a4da8c]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:09:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFnWgClR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:09:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:09:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26365666438346235', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:09:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365666438346235', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:09:59 user nova-compute[76161]: DEBUG nova.objects.instance [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 3a02e8f0-7228-4dde-8c34-55a94356362c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:09:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:09:59 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:09:59 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:09:59 user nova-compute[76161]:   <target dev="vdc" bus="virtio"/>
Nov 14 18:09:59 user nova-compute[76161]:   <serial>bdf8d2a0-7415-48a1-bcdd-e94c097fad53</serial>
Nov 14 18:09:59 user nova-compute[76161]: </disk>
Nov 14 18:09:59 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:09:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:09:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:09:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:09:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] No VIF found with MAC fa:16:3e:7b:89:e1, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:10:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-52ac241a-fa9c-47f3-961b-a3d0f51f8239 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.508s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:01 user nova-compute[76161]: INFO nova.compute.manager [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Detaching volume 2709a11f-f14b-43e8-9279-48df16bb9cd3
Nov 14 18:10:01 user nova-compute[76161]: INFO nova.virt.block_device [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Attempting to driver detach volume 2709a11f-f14b-43e8-9279-48df16bb9cd3 from mountpoint /dev/vdb
Nov 14 18:10:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Attempting to detach device vdb from instance 3a02e8f0-7228-4dde-8c34-55a94356362c from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:10:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:10:01 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:10:01 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:10:01 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:10:01 user nova-compute[76161]:   <serial>2709a11f-f14b-43e8-9279-48df16bb9cd3</serial>
Nov 14 18:10:01 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:10:01 user nova-compute[76161]: </disk>
Nov 14 18:10:01 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:10:01 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully detached device vdb from instance 3a02e8f0-7228-4dde-8c34-55a94356362c from the persistent domain config.
Nov 14 18:10:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a02e8f0-7228-4dde-8c34-55a94356362c from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:10:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:10:01 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:10:01 user nova-compute[76161]:   <source dev="/dev/sde"/>
Nov 14 18:10:01 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:10:01 user nova-compute[76161]:   <serial>2709a11f-f14b-43e8-9279-48df16bb9cd3</serial>
Nov 14 18:10:01 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:10:01 user nova-compute[76161]: </disk>
Nov 14 18:10:01 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:10:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a02e8f0-7228-4dde-8c34-55a94356362c {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:10:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:11 user nova-compute[76161]: INFO nova.compute.manager [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Unshelving
Nov 14 18:10:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:11 user nova-compute[76161]: DEBUG nova.objects.instance [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'pci_requests' on Instance uuid 30f22af1-c024-4da6-bf55-7fba565bd50b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:11 user nova-compute[76161]: DEBUG nova.objects.instance [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'numa_topology' on Instance uuid 30f22af1-c024-4da6-bf55-7fba565bd50b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:11 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:10:11 user nova-compute[76161]: INFO nova.compute.claims [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Claim successful on node user
Nov 14 18:10:11 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:10:12 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:10:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:12 user nova-compute[76161]: INFO nova.network.neutron [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updating port 3148c108-daab-4928-8c8c-35ed2c11a9bc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 18:10:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:10:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquired lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:10:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:10:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-93a0dfa6-1a8f-47a3-933c-ba5ec045cb3d req-58ddd38a-37a2-41e9-8708-ebbdc5fbd4bc service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-changed-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-93a0dfa6-1a8f-47a3-933c-ba5ec045cb3d req-58ddd38a-37a2-41e9-8708-ebbdc5fbd4bc service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Refreshing instance network info cache due to event network-changed-3148c108-daab-4928-8c8c-35ed2c11a9bc. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:10:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-93a0dfa6-1a8f-47a3-933c-ba5ec045cb3d req-58ddd38a-37a2-41e9-8708-ebbdc5fbd4bc service nova] Acquiring lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG nova.network.neutron [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updating instance_info_cache with network_info: [{"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Releasing lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:10:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Creating image(s)
Nov 14 18:10:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "/opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "/opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "/opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG nova.objects.instance [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'trusted_certs' on Instance uuid 30f22af1-c024-4da6-bf55-7fba565bd50b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-93a0dfa6-1a8f-47a3-933c-ba5ec045cb3d req-58ddd38a-37a2-41e9-8708-ebbdc5fbd4bc service nova] Acquired lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG nova.network.neutron [req-93a0dfa6-1a8f-47a3-933c-ba5ec045cb3d req-58ddd38a-37a2-41e9-8708-ebbdc5fbd4bc service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Refreshing network info cache for port 3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG nova.objects.base [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Object Instance<30f22af1-c024-4da6-bf55-7fba565bd50b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "d1a83d34f165620890575882711aec7ee83b87fb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "d1a83d34f165620890575882711aec7ee83b87fb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb.part --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb.part --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG nova.virt.images [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] f70d6c66-4bd0-4263-ae3f-b013b3118fd6 was qcow2, converting to raw {{(pid=76161) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb.part /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb.converted {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb.part /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb.converted" returned: 0 in 0.339s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb.converted --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-93a0dfa6-1a8f-47a3-933c-ba5ec045cb3d req-58ddd38a-37a2-41e9-8708-ebbdc5fbd4bc service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updated VIF entry in instance network info cache for port 3148c108-daab-4928-8c8c-35ed2c11a9bc. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-93a0dfa6-1a8f-47a3-933c-ba5ec045cb3d req-58ddd38a-37a2-41e9-8708-ebbdc5fbd4bc service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updating instance_info_cache with network_info: [{"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-93a0dfa6-1a8f-47a3-933c-ba5ec045cb3d req-58ddd38a-37a2-41e9-8708-ebbdc5fbd4bc service nova] Releasing lock "refresh_cache-30f22af1-c024-4da6-bf55-7fba565bd50b" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "d1a83d34f165620890575882711aec7ee83b87fb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.716s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "d1a83d34f165620890575882711aec7ee83b87fb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "d1a83d34f165620890575882711aec7ee83b87fb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb,backing_fmt=raw /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb,backing_fmt=raw /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk 1073741824" returned: 0 in 0.049s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "d1a83d34f165620890575882711aec7ee83b87fb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG nova.objects.instance [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'migration_context' on Instance uuid 30f22af1-c024-4da6-bf55-7fba565bd50b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG nova.objects.base [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Object Instance<30f22af1-c024-4da6-bf55-7fba565bd50b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:10:15 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Rebasing disk image.
Nov 14 18:10:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d -F raw /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d -F raw /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk" returned: 0 in 2.609s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Ensure instance console log exists: /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Start _get_guest_xml network_info=[{"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e7917a46bedad49c29dd725adf941123',container_format='bare',created_at=2023-11-14T18:08:18Z,direct_url=<?>,disk_format='qcow2',id=f70d6c66-4bd0-4263-ae3f-b013b3118fd6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1109152857-shelved',owner='3e77e9d3740940e6b3c3bbcb66281cdd',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T18:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:10:18 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:10:18 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e7917a46bedad49c29dd725adf941123',container_format='bare',created_at=2023-11-14T18:08:18Z,direct_url=<?>,disk_format='qcow2',id=f70d6c66-4bd0-4263-ae3f-b013b3118fd6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1109152857-shelved',owner='3e77e9d3740940e6b3c3bbcb66281cdd',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T18:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.objects.instance [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30f22af1-c024-4da6-bf55-7fba565bd50b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.objects.base [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Object Instance<30f22af1-c024-4da6-bf55-7fba565bd50b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109152857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109152857',id=40,image_ref='f70d6c66-4bd0-4263-ae3f-b013b3118fd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2021075801',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-2okswtgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member',shelved_at='2023-11-14T18:08:23.018124',shelved_host='user',shelved_image_id='f70d6c66-4bd0-4263-ae3f-b013b3118fd6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=30f22af1-c024-4da6-bf55-7fba565bd50b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.objects.instance [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'pci_devices' on Instance uuid 30f22af1-c024-4da6-bf55-7fba565bd50b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.objects.base [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Object Instance<30f22af1-c024-4da6-bf55-7fba565bd50b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:10:18 user nova-compute[76161]:   <uuid>30f22af1-c024-4da6-bf55-7fba565bd50b</uuid>
Nov 14 18:10:18 user nova-compute[76161]:   <name>instance-00000028</name>
Nov 14 18:10:18 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:10:18 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:10:18 user nova-compute[76161]:   <metadata>
Nov 14 18:10:18 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:10:18 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:10:18 user nova-compute[76161]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1109152857</nova:name>
Nov 14 18:10:18 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:10:18</nova:creationTime>
Nov 14 18:10:18 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:10:18 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:10:18 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:10:18 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:10:18 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:10:18 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:10:18 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:10:18 user nova-compute[76161]:       <nova:owner>
Nov 14 18:10:18 user nova-compute[76161]:         <nova:user uuid="cee653d6630641b89a074a31d8ddddbc">tempest-AttachVolumeShelveTestJSON-1624203066-project-member</nova:user>
Nov 14 18:10:18 user nova-compute[76161]:         <nova:project uuid="3e77e9d3740940e6b3c3bbcb66281cdd">tempest-AttachVolumeShelveTestJSON-1624203066</nova:project>
Nov 14 18:10:18 user nova-compute[76161]:       </nova:owner>
Nov 14 18:10:18 user nova-compute[76161]:       <nova:root type="image" uuid="f70d6c66-4bd0-4263-ae3f-b013b3118fd6"/>
Nov 14 18:10:18 user nova-compute[76161]:       <nova:ports>
Nov 14 18:10:18 user nova-compute[76161]:         <nova:port uuid="3148c108-daab-4928-8c8c-35ed2c11a9bc">
Nov 14 18:10:18 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 18:10:18 user nova-compute[76161]:         </nova:port>
Nov 14 18:10:18 user nova-compute[76161]:       </nova:ports>
Nov 14 18:10:18 user nova-compute[76161]:     </nova:instance>
Nov 14 18:10:18 user nova-compute[76161]:   </metadata>
Nov 14 18:10:18 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:10:18 user nova-compute[76161]:     <system>
Nov 14 18:10:18 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:10:18 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:10:18 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:10:18 user nova-compute[76161]:       <entry name="serial">30f22af1-c024-4da6-bf55-7fba565bd50b</entry>
Nov 14 18:10:18 user nova-compute[76161]:       <entry name="uuid">30f22af1-c024-4da6-bf55-7fba565bd50b</entry>
Nov 14 18:10:18 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:10:18 user nova-compute[76161]:     </system>
Nov 14 18:10:18 user nova-compute[76161]:   </sysinfo>
Nov 14 18:10:18 user nova-compute[76161]:   <os>
Nov 14 18:10:18 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:10:18 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:10:18 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:10:18 user nova-compute[76161]:   </os>
Nov 14 18:10:18 user nova-compute[76161]:   <features>
Nov 14 18:10:18 user nova-compute[76161]:     <acpi/>
Nov 14 18:10:18 user nova-compute[76161]:     <apic/>
Nov 14 18:10:18 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:10:18 user nova-compute[76161]:   </features>
Nov 14 18:10:18 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:10:18 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:10:18 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:10:18 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:10:18 user nova-compute[76161]:   </clock>
Nov 14 18:10:18 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:10:18 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:10:18 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:10:18 user nova-compute[76161]:   </cpu>
Nov 14 18:10:18 user nova-compute[76161]:   <devices>
Nov 14 18:10:18 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:10:18 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:10:18 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk"/>
Nov 14 18:10:18 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:10:18 user nova-compute[76161]:     </disk>
Nov 14 18:10:18 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:10:18 user nova-compute[76161]:       <mac address="fa:16:3e:d6:60:96"/>
Nov 14 18:10:18 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:10:18 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:10:18 user nova-compute[76161]:       <target dev="tap3148c108-da"/>
Nov 14 18:10:18 user nova-compute[76161]:     </interface>
Nov 14 18:10:18 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:10:18 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/console.log" append="off"/>
Nov 14 18:10:18 user nova-compute[76161]:     </serial>
Nov 14 18:10:18 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:10:18 user nova-compute[76161]:     <video>
Nov 14 18:10:18 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:10:18 user nova-compute[76161]:     </video>
Nov 14 18:10:18 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:10:18 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:10:18 user nova-compute[76161]:     </rng>
Nov 14 18:10:18 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:10:18 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:10:18 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:10:18 user nova-compute[76161]:     </memballoon>
Nov 14 18:10:18 user nova-compute[76161]:   </devices>
Nov 14 18:10:18 user nova-compute[76161]: </domain>
Nov 14 18:10:18 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109152857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109152857',id=40,image_ref='f70d6c66-4bd0-4263-ae3f-b013b3118fd6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2021075801',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-2okswtgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member',shelved_at='2023-11-14T18:08:23.018124',shelved_host='user',shelved_image_id='f70d6c66-4bd0-4263-ae3f-b013b3118fd6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=30f22af1-c024-4da6-bf55-7fba565bd50b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG os_vif [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee857c3d-d7bd-5f12-944d-b27ef20e53f8', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3148c108-da, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3148c108-da, col_values=(('qos', UUID('31a55de9-8225-40aa-837b-0b79e134c6d8')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3148c108-da, col_values=(('external_ids', {'iface-id': '3148c108-daab-4928-8c8c-35ed2c11a9bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:60:96', 'vm-uuid': '30f22af1-c024-4da6-bf55-7fba565bd50b'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:18 user nova-compute[76161]: INFO os_vif [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da')
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:10:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] No VIF found with MAC fa:16:3e:d6:60:96, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:10:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-82225b9c-c70c-494b-b771-0fd7772fe898 req-d9ebd128-9910-4213-84dc-b2042cc568ae service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-82225b9c-c70c-494b-b771-0fd7772fe898 req-d9ebd128-9910-4213-84dc-b2042cc568ae service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-82225b9c-c70c-494b-b771-0fd7772fe898 req-d9ebd128-9910-4213-84dc-b2042cc568ae service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-82225b9c-c70c-494b-b771-0fd7772fe898 req-d9ebd128-9910-4213-84dc-b2042cc568ae service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-82225b9c-c70c-494b-b771-0fd7772fe898 req-d9ebd128-9910-4213-84dc-b2042cc568ae service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:10:20 user nova-compute[76161]: WARNING nova.compute.manager [req-82225b9c-c70c-494b-b771-0fd7772fe898 req-d9ebd128-9910-4213-84dc-b2042cc568ae service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 18:10:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:10:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:10:21 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Instance spawned successfully.
Nov 14 18:10:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-b5c477fb-2977-4754-8bca-3e34cd72222b req-8f14b1ef-c6a2-4989-92de-b93b5a485873 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b5c477fb-2977-4754-8bca-3e34cd72222b req-8f14b1ef-c6a2-4989-92de-b93b5a485873 service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b5c477fb-2977-4754-8bca-3e34cd72222b req-8f14b1ef-c6a2-4989-92de-b93b5a485873 service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b5c477fb-2977-4754-8bca-3e34cd72222b req-8f14b1ef-c6a2-4989-92de-b93b5a485873 service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-b5c477fb-2977-4754-8bca-3e34cd72222b req-8f14b1ef-c6a2-4989-92de-b93b5a485873 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:10:22 user nova-compute[76161]: WARNING nova.compute.manager [req-b5c477fb-2977-4754-8bca-3e34cd72222b req-8f14b1ef-c6a2-4989-92de-b93b5a485873 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 18:10:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:10:22 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3a02e8f0-7228-4dde-8c34-55a94356362c is timed out.
Nov 14 18:10:22 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully detached device vdb from instance 3a02e8f0-7228-4dde-8c34-55a94356362c from the live domain config.
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-dbb909c3-0444-4bbe-bc07-0e6f494fe56a tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.785s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMxOYdom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:10:22 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[98670d71-7dcd-4deb-9cca-ee75c65f3077]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:10:22 user nova-compute[76161]: No targets found.
Nov 14 18:10:22 user nova-compute[76161]: iSNS:
Nov 14 18:10:22 user nova-compute[76161]: No targets found.
Nov 14 18:10:22 user nova-compute[76161]: STATIC:
Nov 14 18:10:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b
Nov 14 18:10:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:10:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:10:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53
Nov 14 18:10:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:10:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:10:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea
Nov 14 18:10:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:10:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:10:22 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3
Nov 14 18:10:22 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:10:22 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:10:22 user nova-compute[76161]: FIRMWARE:
Nov 14 18:10:22 user nova-compute[76161]: No targets found.
Nov 14 18:10:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:10:22 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:10:22 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64cf9e7-227f-42f5-a280-d05d2fcaa46b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb14bb0-bb8b-4a49-8013-4250f77aa2d2]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:10:22 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:10:22 user nova-compute[76161]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)
Nov 14 18:10:22 user nova-compute[76161]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)
Nov 14 18:10:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:10:22 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:10:22 user nova-compute[76161]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 (non-flash)
Nov 14 18:10:22 user nova-compute[76161]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)
Nov 14 18:10:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0128940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3'): ({'sde'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Removing single pathed devices sde {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a384ac9f-f793-4c77-94cd-83d00989c093]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f60b4bb-8175-44aa-9a92-54c4624c7be0]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flushing IO for device /dev/sde {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a9ceec-a4e4-4086-9539-4b4261b3f771]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[606a7322-8ac7-442f-b0f0-60e4197d98a1]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] SCSI volumes sde have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b89294-f0eb-4e7a-b2bc-d3e95cf48c10]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fc4c59-8c29-4ada-b499-383efa82495a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3, portal: 172.16.0.220,3260]
Nov 14 18:10:22 user nova-compute[76161]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3, portal: 172.16.0.220,3260] successful.
Nov 14 18:10:22 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709a11f-f14b-43e8-9279-48df16bb9cd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d09d048-77f2-46e1-a76c-a36a881c8ba5]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== disconnect_volume: return (308ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:10:22 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:10:23 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:23 user nova-compute[76161]: DEBUG nova.objects.instance [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 3a02e8f0-7228-4dde-8c34-55a94356362c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b9f9606d-bd5f-4732-ad38-e8268fcfa64a tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.784s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:24 user nova-compute[76161]: INFO nova.compute.manager [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Detaching volume bdf8d2a0-7415-48a1-bcdd-e94c097fad53
Nov 14 18:10:24 user nova-compute[76161]: INFO nova.virt.block_device [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Attempting to driver detach volume bdf8d2a0-7415-48a1-bcdd-e94c097fad53 from mountpoint /dev/vdc
Nov 14 18:10:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Attempting to detach device vdc from instance 3a02e8f0-7228-4dde-8c34-55a94356362c from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:10:24 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:10:24 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:10:24 user nova-compute[76161]:   <target dev="vdc" bus="virtio"/>
Nov 14 18:10:24 user nova-compute[76161]:   <serial>bdf8d2a0-7415-48a1-bcdd-e94c097fad53</serial>
Nov 14 18:10:24 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 18:10:24 user nova-compute[76161]: </disk>
Nov 14 18:10:24 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:10:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully detached device vdc from instance 3a02e8f0-7228-4dde-8c34-55a94356362c from the persistent domain config.
Nov 14 18:10:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3a02e8f0-7228-4dde-8c34-55a94356362c from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:10:24 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:10:24 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:10:24 user nova-compute[76161]:   <target dev="vdc" bus="virtio"/>
Nov 14 18:10:24 user nova-compute[76161]:   <serial>bdf8d2a0-7415-48a1-bcdd-e94c097fad53</serial>
Nov 14 18:10:24 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 18:10:24 user nova-compute[76161]: </disk>
Nov 14 18:10:24 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updating instance_info_cache with network_info: [{"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:24 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:25 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3a02e8f0-7228-4dde-8c34-55a94356362c {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:10:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:31 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:32 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk.rescue --force-share --output=json" returned: 0 in 0.346s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:33 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:35 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:10:35 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8160MB free_disk=25.116870880126953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance a0ec5fe2-517b-498c-8606-9417432c8803 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e4f6135c-879b-4a15-8798-b6d83e5823da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 3a02e8f0-7228-4dde-8c34-55a94356362c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 30f22af1-c024-4da6-bf55-7fba565bd50b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing inventories for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating ProviderTree inventory for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing aggregate associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, aggregates: None {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 18:10:35 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing trait associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 18:10:36 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:10:36 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:10:36 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:10:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 18:10:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] There are 0 instances to clean {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 18:10:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:10:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76161) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 18:10:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "a0ec5fe2-517b-498c-8606-9417432c8803" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "a0ec5fe2-517b-498c-8606-9417432c8803" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:43 user nova-compute[76161]: INFO nova.compute.manager [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Terminating instance
Nov 14 18:10:43 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG nova.compute.manager [req-1303b95a-7232-40f7-a25b-437b98d45b46 req-7cc277b3-9050-4482-bae9-55d336177e4e service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received event network-vif-unplugged-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1303b95a-7232-40f7-a25b-437b98d45b46 req-7cc277b3-9050-4482-bae9-55d336177e4e service nova] Acquiring lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1303b95a-7232-40f7-a25b-437b98d45b46 req-7cc277b3-9050-4482-bae9-55d336177e4e service nova] Lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1303b95a-7232-40f7-a25b-437b98d45b46 req-7cc277b3-9050-4482-bae9-55d336177e4e service nova] Lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG nova.compute.manager [req-1303b95a-7232-40f7-a25b-437b98d45b46 req-7cc277b3-9050-4482-bae9-55d336177e4e service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] No waiting events found dispatching network-vif-unplugged-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG nova.compute.manager [req-1303b95a-7232-40f7-a25b-437b98d45b46 req-7cc277b3-9050-4482-bae9-55d336177e4e service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received event network-vif-unplugged-fbdc6a40-096f-4f70-8a59-a478924938ad for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:10:43 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Instance destroyed successfully.
Nov 14 18:10:43 user nova-compute[76161]: DEBUG nova.objects.instance [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'resources' on Instance uuid a0ec5fe2-517b-498c-8606-9417432c8803 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1291280286',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1291280286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1291280286',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfNSbhXXnYI8neJ3qtubOKUzNy8IKMoHa/oFqyhpscePdLtzld8SeKTMwtclpNlwsRwTlZBMEdjlYeZ5/1RyXaEVDbxD1Td+6BK1iWGWslsXAMS48piWanWtc4xCN8Yaw==',key_name='tempest-keypair-1070313770',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:06:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-4xsa5300',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:06:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=a0ec5fe2-517b-498c-8606-9417432c8803,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "fbdc6a40-096f-4f70-8a59-a478924938ad", "address": "fa:16:3e:02:38:9a", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbdc6a40-09", "ovs_interfaceid": "fbdc6a40-096f-4f70-8a59-a478924938ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:38:9a,bridge_name='br-int',has_traffic_filtering=True,id=fbdc6a40-096f-4f70-8a59-a478924938ad,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbdc6a40-09') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG os_vif [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:38:9a,bridge_name='br-int',has_traffic_filtering=True,id=fbdc6a40-096f-4f70-8a59-a478924938ad,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbdc6a40-09') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbdc6a40-09, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7df7a188-1a38-441c-ae0c-feb906721e8a) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:10:43 user nova-compute[76161]: INFO os_vif [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:38:9a,bridge_name='br-int',has_traffic_filtering=True,id=fbdc6a40-096f-4f70-8a59-a478924938ad,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbdc6a40-09')
Nov 14 18:10:43 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoCiAcUd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:10:43 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:10:43 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4479e421-cff4-4886-8281-3cc7836de600]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:10:43 user nova-compute[76161]: No targets found.
Nov 14 18:10:43 user nova-compute[76161]: iSNS:
Nov 14 18:10:43 user nova-compute[76161]: No targets found.
Nov 14 18:10:43 user nova-compute[76161]: STATIC:
Nov 14 18:10:43 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b
Nov 14 18:10:43 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:10:43 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:10:43 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53
Nov 14 18:10:43 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:10:43 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:10:43 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea
Nov 14 18:10:43 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:10:43 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:10:43 user nova-compute[76161]: FIRMWARE:
Nov 14 18:10:43 user nova-compute[76161]: No targets found.
Nov 14 18:10:43 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:10:43 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:10:43 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:10:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[171561a8-d3a2-4f0f-aef1-4b7eb1ef5e31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16a9a3c-a55c-41b4-b6d9-1f40c7e716fd]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:10:44 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:10:44 user nova-compute[76161]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)
Nov 14 18:10:44 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea (non-flash)
Nov 14 18:10:44 user nova-compute[76161]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:10:44 user nova-compute[76161]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)
Nov 14 18:10:44 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f06e0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4703fdd-6cb5-4bcc-a42d-9888fe05223a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfda85e-2f77-4c2c-a7c2-25727ccc470d]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eae92e-46ad-4187-ac08-344340ee38a8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[02df3f5c-fdfa-469e-8cd5-05527eb42b23]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26666333661363664', '/dev/disk/by-id/scsi-1SCST_BIO13ec8f71-ff36a66d47294c46', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_13ec8f71') {{(pid=86560) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8359a9d9-57ca-408c-99b6-5d4f2d7bc145]: (4, None) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2ff583-0a53-416a-ab47-c280ce4aae91]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e556215e-0e3d-484b-b138-23918ff2e57b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea, portal: 172.16.0.220,3260]
Nov 14 18:10:44 user nova-compute[76161]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea, portal: 172.16.0.220,3260] successful.
Nov 14 18:10:44 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f74f42-74d9-415a-93ee-49395d621eea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62c98c4-fc2a-49fc-add6-5684e6843cb4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== disconnect_volume: return (368ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:10:44 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Deleting instance files /opt/stack/data/nova/instances/a0ec5fe2-517b-498c-8606-9417432c8803_del
Nov 14 18:10:44 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Deletion of /opt/stack/data/nova/instances/a0ec5fe2-517b-498c-8606-9417432c8803_del complete
Nov 14 18:10:44 user nova-compute[76161]: INFO nova.compute.manager [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Acquiring lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:10:44 user nova-compute[76161]: INFO nova.compute.claims [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Claim successful on node user
Nov 14 18:10:44 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:44 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:10:45 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:10:45 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Took 0.72 seconds to deallocate network for instance.
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.compute.manager [req-d6aeef38-9e2f-4af0-8847-936d27c0afc6 req-036bc621-a2ee-47d0-85fc-20b3a7dcfb8b service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received event network-vif-deleted-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:10:45 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Creating image(s)
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Acquiring lock "/opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "/opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "/opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:45 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3a02e8f0-7228-4dde-8c34-55a94356362c is timed out.
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.policy [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1031c39ae143468b98f600d791424eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ecb05577514b548ec317e2cc01e1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:10:45 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully detached device vdc from instance 3a02e8f0-7228-4dde-8c34-55a94356362c from the live domain config.
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFnWgClR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:10:45 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58b07ea-bcb9-4f3d-b620-730bc64ec131]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:10:45 user nova-compute[76161]: No targets found.
Nov 14 18:10:45 user nova-compute[76161]: iSNS:
Nov 14 18:10:45 user nova-compute[76161]: No targets found.
Nov 14 18:10:45 user nova-compute[76161]: STATIC:
Nov 14 18:10:45 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b
Nov 14 18:10:45 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:10:45 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:10:45 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53
Nov 14 18:10:45 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:10:45 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:10:45 user nova-compute[76161]: FIRMWARE:
Nov 14 18:10:45 user nova-compute[76161]: No targets found.
Nov 14 18:10:45 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:10:45 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:10:45 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3132f9-f5cf-4abf-a6d4-9dcf65ae3bc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d68a9e6-3d70-4ef3-97d7-805794ae17ab]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:10:45 user nova-compute[76161]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)
Nov 14 18:10:45 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:10:45 user nova-compute[76161]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 (non-flash)
Nov 14 18:10:45 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f014c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[847f5f65-3ab2-459f-9a84-fc5fac2e2d53]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.192s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4364888b-53a5-4f8b-803a-3dc099fa3065]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e62d72-a7b2-4c40-b9a3-f2be5e4af598]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec2e317-25be-4a5b-9968-da940c51d7c6]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f548d81-5364-426d-96c7-8ab3defe56ab]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[47223a11-e566-4056-9462-d6c911dca72f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53, portal: 172.16.0.220,3260]
Nov 14 18:10:45 user nova-compute[76161]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53, portal: 172.16.0.220,3260] successful.
Nov 14 18:10:45 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk 1073741824" returned: 0 in 0.052s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdf8d2a0-7415-48a1-bcdd-e94c097fad53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6eca74-d92a-4ba2-877d-f044f3067321]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] <== disconnect_volume: return (419ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.compute.manager [req-568bd99e-90b4-4eb0-ac02-08b60ef222e4 req-c2892819-ee73-4cca-aa49-aaca996e0175 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received event network-vif-plugged-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-568bd99e-90b4-4eb0-ac02-08b60ef222e4 req-c2892819-ee73-4cca-aa49-aaca996e0175 service nova] Acquiring lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-568bd99e-90b4-4eb0-ac02-08b60ef222e4 req-c2892819-ee73-4cca-aa49-aaca996e0175 service nova] Lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-568bd99e-90b4-4eb0-ac02-08b60ef222e4 req-c2892819-ee73-4cca-aa49-aaca996e0175 service nova] Lock "a0ec5fe2-517b-498c-8606-9417432c8803-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.compute.manager [req-568bd99e-90b4-4eb0-ac02-08b60ef222e4 req-c2892819-ee73-4cca-aa49-aaca996e0175 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] No waiting events found dispatching network-vif-plugged-fbdc6a40-096f-4f70-8a59-a478924938ad {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:10:45 user nova-compute[76161]: WARNING nova.compute.manager [req-568bd99e-90b4-4eb0-ac02-08b60ef222e4 req-c2892819-ee73-4cca-aa49-aaca996e0175 service nova] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Received unexpected event network-vif-plugged-fbdc6a40-096f-4f70-8a59-a478924938ad for instance with vm_state active and task_state deleting.
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:10:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:10:45 user nova-compute[76161]: INFO nova.compute.manager [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Took 0.82 seconds to detach 1 volumes for instance.
Nov 14 18:10:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: a0ec5fe2-517b-498c-8606-9417432c8803] Deleting volume: 38f74f42-74d9-415a-93ee-49395d621eea {{(pid=76161) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Cannot resize image /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Ensure instance console log exists: /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Successfully created port: dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:46 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Deleted allocations for instance a0ec5fe2-517b-498c-8606-9417432c8803
Nov 14 18:10:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b957ef6a-d773-442b-889d-a037a26a1313 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "a0ec5fe2-517b-498c-8606-9417432c8803" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.418s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG nova.objects.instance [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'flavor' on Instance uuid 3a02e8f0-7228-4dde-8c34-55a94356362c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-93cc255a-0e4e-412f-9701-14643a1e88f2 tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.109s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Successfully updated port: dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Acquiring lock "refresh_cache-e32b1199-adf6-42ad-9a73-692aeb5e22a2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Acquired lock "refresh_cache-e32b1199-adf6-42ad-9a73-692aeb5e22a2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-4b91811c-589f-4ea3-8a82-c144d92fe9ac req-aaefc3c9-7e4b-4b93-9658-1e1a9b97d9bd service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Received event network-changed-dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.compute.manager [req-4b91811c-589f-4ea3-8a82-c144d92fe9ac req-aaefc3c9-7e4b-4b93-9658-1e1a9b97d9bd service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Refreshing instance network info cache due to event network-changed-dac79aa2-eff8-454f-89ff-7452f58bf4aa. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4b91811c-589f-4ea3-8a82-c144d92fe9ac req-aaefc3c9-7e4b-4b93-9658-1e1a9b97d9bd service nova] Acquiring lock "refresh_cache-e32b1199-adf6-42ad-9a73-692aeb5e22a2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Updating instance_info_cache with network_info: [{"id": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "address": "fa:16:3e:6c:95:30", "network": {"id": "331573ee-39a3-4a1a-bf94-bdf83b8761b2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5959f76ddcb0476184d4947075ac629a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac79aa2-ef", "ovs_interfaceid": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Releasing lock "refresh_cache-e32b1199-adf6-42ad-9a73-692aeb5e22a2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Instance network_info: |[{"id": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "address": "fa:16:3e:6c:95:30", "network": {"id": "331573ee-39a3-4a1a-bf94-bdf83b8761b2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5959f76ddcb0476184d4947075ac629a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac79aa2-ef", "ovs_interfaceid": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4b91811c-589f-4ea3-8a82-c144d92fe9ac req-aaefc3c9-7e4b-4b93-9658-1e1a9b97d9bd service nova] Acquired lock "refresh_cache-e32b1199-adf6-42ad-9a73-692aeb5e22a2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.network.neutron [req-4b91811c-589f-4ea3-8a82-c144d92fe9ac req-aaefc3c9-7e4b-4b93-9658-1e1a9b97d9bd service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Refreshing network info cache for port dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Start _get_guest_xml network_info=[{"id": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "address": "fa:16:3e:6c:95:30", "network": {"id": "331573ee-39a3-4a1a-bf94-bdf83b8761b2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5959f76ddcb0476184d4947075ac629a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac79aa2-ef", "ovs_interfaceid": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:10:47 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:10:47 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-716323715',display_name='tempest-VolumesNegativeTest-instance-716323715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-716323715',id=45,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7ecb05577514b548ec317e2cc01e1e3',ramdisk_id='',reservation_id='r-3855ambi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-785450454',owner_user_name='tempest-VolumesNegativeTest-785450454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:10:45Z,user_data=None,user_id='1031c39ae143468b98f600d791424eac',uuid=e32b1199-adf6-42ad-9a73-692aeb5e22a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "address": "fa:16:3e:6c:95:30", "network": {"id": "331573ee-39a3-4a1a-bf94-bdf83b8761b2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5959f76ddcb0476184d4947075ac629a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac79aa2-ef", "ovs_interfaceid": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Converting VIF {"id": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "address": "fa:16:3e:6c:95:30", "network": {"id": "331573ee-39a3-4a1a-bf94-bdf83b8761b2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5959f76ddcb0476184d4947075ac629a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac79aa2-ef", "ovs_interfaceid": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:95:30,bridge_name='br-int',has_traffic_filtering=True,id=dac79aa2-eff8-454f-89ff-7452f58bf4aa,network=Network(331573ee-39a3-4a1a-bf94-bdf83b8761b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac79aa2-ef') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lazy-loading 'pci_devices' on Instance uuid e32b1199-adf6-42ad-9a73-692aeb5e22a2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:10:47 user nova-compute[76161]:   <uuid>e32b1199-adf6-42ad-9a73-692aeb5e22a2</uuid>
Nov 14 18:10:47 user nova-compute[76161]:   <name>instance-0000002d</name>
Nov 14 18:10:47 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:10:47 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:10:47 user nova-compute[76161]:   <metadata>
Nov 14 18:10:47 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:10:47 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:10:47 user nova-compute[76161]:       <nova:name>tempest-VolumesNegativeTest-instance-716323715</nova:name>
Nov 14 18:10:47 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:10:47</nova:creationTime>
Nov 14 18:10:47 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:10:47 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:10:47 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:10:47 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:10:47 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:10:47 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:10:47 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:10:47 user nova-compute[76161]:       <nova:owner>
Nov 14 18:10:47 user nova-compute[76161]:         <nova:user uuid="1031c39ae143468b98f600d791424eac">tempest-VolumesNegativeTest-785450454-project-member</nova:user>
Nov 14 18:10:47 user nova-compute[76161]:         <nova:project uuid="d7ecb05577514b548ec317e2cc01e1e3">tempest-VolumesNegativeTest-785450454</nova:project>
Nov 14 18:10:47 user nova-compute[76161]:       </nova:owner>
Nov 14 18:10:47 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:10:47 user nova-compute[76161]:       <nova:ports>
Nov 14 18:10:47 user nova-compute[76161]:         <nova:port uuid="dac79aa2-eff8-454f-89ff-7452f58bf4aa">
Nov 14 18:10:47 user nova-compute[76161]:           <nova:ip type="fixed" address="192.168.233.12" ipVersion="4"/>
Nov 14 18:10:47 user nova-compute[76161]:         </nova:port>
Nov 14 18:10:47 user nova-compute[76161]:       </nova:ports>
Nov 14 18:10:47 user nova-compute[76161]:     </nova:instance>
Nov 14 18:10:47 user nova-compute[76161]:   </metadata>
Nov 14 18:10:47 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:10:47 user nova-compute[76161]:     <system>
Nov 14 18:10:47 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:10:47 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:10:47 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:10:47 user nova-compute[76161]:       <entry name="serial">e32b1199-adf6-42ad-9a73-692aeb5e22a2</entry>
Nov 14 18:10:47 user nova-compute[76161]:       <entry name="uuid">e32b1199-adf6-42ad-9a73-692aeb5e22a2</entry>
Nov 14 18:10:47 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:10:47 user nova-compute[76161]:     </system>
Nov 14 18:10:47 user nova-compute[76161]:   </sysinfo>
Nov 14 18:10:47 user nova-compute[76161]:   <os>
Nov 14 18:10:47 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:10:47 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:10:47 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:10:47 user nova-compute[76161]:   </os>
Nov 14 18:10:47 user nova-compute[76161]:   <features>
Nov 14 18:10:47 user nova-compute[76161]:     <acpi/>
Nov 14 18:10:47 user nova-compute[76161]:     <apic/>
Nov 14 18:10:47 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:10:47 user nova-compute[76161]:   </features>
Nov 14 18:10:47 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:10:47 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:10:47 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:10:47 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:10:47 user nova-compute[76161]:   </clock>
Nov 14 18:10:47 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:10:47 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:10:47 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:10:47 user nova-compute[76161]:   </cpu>
Nov 14 18:10:47 user nova-compute[76161]:   <devices>
Nov 14 18:10:47 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:10:47 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:10:47 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk"/>
Nov 14 18:10:47 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:10:47 user nova-compute[76161]:     </disk>
Nov 14 18:10:47 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:10:47 user nova-compute[76161]:       <mac address="fa:16:3e:6c:95:30"/>
Nov 14 18:10:47 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:10:47 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:10:47 user nova-compute[76161]:       <target dev="tapdac79aa2-ef"/>
Nov 14 18:10:47 user nova-compute[76161]:     </interface>
Nov 14 18:10:47 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:10:47 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/console.log" append="off"/>
Nov 14 18:10:47 user nova-compute[76161]:     </serial>
Nov 14 18:10:47 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:10:47 user nova-compute[76161]:     <video>
Nov 14 18:10:47 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:10:47 user nova-compute[76161]:     </video>
Nov 14 18:10:47 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:10:47 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:10:47 user nova-compute[76161]:     </rng>
Nov 14 18:10:47 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:10:47 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:10:47 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:10:47 user nova-compute[76161]:     </memballoon>
Nov 14 18:10:47 user nova-compute[76161]:   </devices>
Nov 14 18:10:47 user nova-compute[76161]: </domain>
Nov 14 18:10:47 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-716323715',display_name='tempest-VolumesNegativeTest-instance-716323715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-716323715',id=45,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7ecb05577514b548ec317e2cc01e1e3',ramdisk_id='',reservation_id='r-3855ambi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-785450454',owner_user_name='tempest-VolumesNegativeTest-785450454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:10:45Z,user_data=None,user_id='1031c39ae143468b98f600d791424eac',uuid=e32b1199-adf6-42ad-9a73-692aeb5e22a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "address": "fa:16:3e:6c:95:30", "network": {"id": "331573ee-39a3-4a1a-bf94-bdf83b8761b2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5959f76ddcb0476184d4947075ac629a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac79aa2-ef", "ovs_interfaceid": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Converting VIF {"id": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "address": "fa:16:3e:6c:95:30", "network": {"id": "331573ee-39a3-4a1a-bf94-bdf83b8761b2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5959f76ddcb0476184d4947075ac629a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac79aa2-ef", "ovs_interfaceid": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:95:30,bridge_name='br-int',has_traffic_filtering=True,id=dac79aa2-eff8-454f-89ff-7452f58bf4aa,network=Network(331573ee-39a3-4a1a-bf94-bdf83b8761b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac79aa2-ef') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG os_vif [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:95:30,bridge_name='br-int',has_traffic_filtering=True,id=dac79aa2-eff8-454f-89ff-7452f58bf4aa,network=Network(331573ee-39a3-4a1a-bf94-bdf83b8761b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac79aa2-ef') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93ebea1d-e427-5ce0-9e61-9550318db7e5', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:47 user nova-compute[76161]: INFO nova.compute.manager [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Terminating instance
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdac79aa2-ef, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdac79aa2-ef, col_values=(('qos', UUID('b7e55a01-fc00-4337-b97e-0ff4e5064b5f')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdac79aa2-ef, col_values=(('external_ids', {'iface-id': 'dac79aa2-eff8-454f-89ff-7452f58bf4aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:95:30', 'vm-uuid': 'e32b1199-adf6-42ad-9a73-692aeb5e22a2'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:47 user nova-compute[76161]: INFO os_vif [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:95:30,bridge_name='br-int',has_traffic_filtering=True,id=dac79aa2-eff8-454f-89ff-7452f58bf4aa,network=Network(331573ee-39a3-4a1a-bf94-bdf83b8761b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac79aa2-ef')
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] No VIF found with MAC fa:16:3e:6c:95:30, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG nova.network.neutron [req-4b91811c-589f-4ea3-8a82-c144d92fe9ac req-aaefc3c9-7e4b-4b93-9658-1e1a9b97d9bd service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Updated VIF entry in instance network info cache for port dac79aa2-eff8-454f-89ff-7452f58bf4aa. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG nova.network.neutron [req-4b91811c-589f-4ea3-8a82-c144d92fe9ac req-aaefc3c9-7e4b-4b93-9658-1e1a9b97d9bd service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Updating instance_info_cache with network_info: [{"id": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "address": "fa:16:3e:6c:95:30", "network": {"id": "331573ee-39a3-4a1a-bf94-bdf83b8761b2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5959f76ddcb0476184d4947075ac629a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac79aa2-ef", "ovs_interfaceid": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4b91811c-589f-4ea3-8a82-c144d92fe9ac req-aaefc3c9-7e4b-4b93-9658-1e1a9b97d9bd service nova] Releasing lock "refresh_cache-e32b1199-adf6-42ad-9a73-692aeb5e22a2" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:10:48 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Instance destroyed successfully.
Nov 14 18:10:48 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lazy-loading 'resources' on Instance uuid 3a02e8f0-7228-4dde-8c34-55a94356362c {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1844963921',display_name='tempest-AttachVolumeTestJSON-server-1844963921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1844963921',id=42,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJt4KDe0SjR6HprUvNPeZnYFjsLoaDm7wAD7BrxUPzemNaFjz+ipxNJDEUSvPaT4I1EktQFg9ilGD8+uze53wSnEQypDeULh/vFtcTLt3bF7CljzFR5gTjm85I2LvANkzg==',key_name='tempest-keypair-246721526',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0413439dcb2e49d496bf267c63163178',ramdisk_id='',reservation_id='r-moyxp854',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1978358229',owner_user_name='tempest-AttachVolumeTestJSON-1978358229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7172f3aea4ef29587ca01c39be2f6',uuid=3a02e8f0-7228-4dde-8c34-55a94356362c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converting VIF {"id": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "address": "fa:16:3e:7b:89:e1", "network": {"id": "b87be9f2-0492-43a4-8b4c-65863d503faf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1989546503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0413439dcb2e49d496bf267c63163178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7554ffa2-25", "ovs_interfaceid": "7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:89:e1,bridge_name='br-int',has_traffic_filtering=True,id=7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7554ffa2-25') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG os_vif [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:89:e1,bridge_name='br-int',has_traffic_filtering=True,id=7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7554ffa2-25') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7554ffa2-25, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6da5417-22cc-41fe-8414-164001ee061b) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:48 user nova-compute[76161]: INFO os_vif [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:89:e1,bridge_name='br-int',has_traffic_filtering=True,id=7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e,network=Network(b87be9f2-0492-43a4-8b4c-65863d503faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7554ffa2-25')
Nov 14 18:10:48 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Deleting instance files /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c_del
Nov 14 18:10:48 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Deletion of /opt/stack/data/nova/instances/3a02e8f0-7228-4dde-8c34-55a94356362c_del complete
Nov 14 18:10:48 user nova-compute[76161]: INFO nova.compute.manager [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 18:10:48 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:10:48 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received event network-vif-unplugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] No waiting events found dispatching network-vif-unplugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received event network-vif-unplugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received event network-vif-plugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] Acquiring lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] No waiting events found dispatching network-vif-plugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:10:49 user nova-compute[76161]: WARNING nova.compute.manager [req-a7e5a5b7-8fe2-4751-a007-10b7602d1e38 req-f080b100-c0a6-44c0-880a-4f726fb5a4bb service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received unexpected event network-vif-plugged-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e for instance with vm_state active and task_state deleting.
Nov 14 18:10:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-45c183ff-fdc8-44d5-b35f-1240e7553ce8 req-367477eb-2998-40fa-8c70-128cca816ac8 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Received event network-vif-plugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-45c183ff-fdc8-44d5-b35f-1240e7553ce8 req-367477eb-2998-40fa-8c70-128cca816ac8 service nova] Acquiring lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-45c183ff-fdc8-44d5-b35f-1240e7553ce8 req-367477eb-2998-40fa-8c70-128cca816ac8 service nova] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-45c183ff-fdc8-44d5-b35f-1240e7553ce8 req-367477eb-2998-40fa-8c70-128cca816ac8 service nova] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-45c183ff-fdc8-44d5-b35f-1240e7553ce8 req-367477eb-2998-40fa-8c70-128cca816ac8 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] No waiting events found dispatching network-vif-plugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:10:49 user nova-compute[76161]: WARNING nova.compute.manager [req-45c183ff-fdc8-44d5-b35f-1240e7553ce8 req-367477eb-2998-40fa-8c70-128cca816ac8 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Received unexpected event network-vif-plugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa for instance with vm_state building and task_state spawning.
Nov 14 18:10:49 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Took 0.91 seconds to deallocate network for instance.
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:10:49 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:10:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:50 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Deleted allocations for instance 3a02e8f0-7228-4dde-8c34-55a94356362c
Nov 14 18:10:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e597166b-2444-47a5-8bbe-b714372b3a7e tempest-AttachVolumeTestJSON-1978358229 tempest-AttachVolumeTestJSON-1978358229-project-member] Lock "3a02e8f0-7228-4dde-8c34-55a94356362c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.589s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-e9f9a1a0-ac86-47b8-9502-f116a8681edd req-7db987cb-3168-4632-9b6d-01fb07f76544 service nova] [instance: 3a02e8f0-7228-4dde-8c34-55a94356362c] Received event network-vif-deleted-7554ffa2-25a0-4c7a-a9b1-8d55ccae2c4e {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:10:51 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Instance spawned successfully.
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:10:51 user nova-compute[76161]: INFO nova.compute.manager [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:10:51 user nova-compute[76161]: INFO nova.compute.manager [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Took 6.97 seconds to build instance.
Nov 14 18:10:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c4a6eada-a1e4-4b30-804b-4ee7b2ab80fa tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.064s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-5018894c-9c81-4d6f-8c8f-ac805d6530b7 req-b01302fc-3563-4d64-a9df-6aa4db7df552 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Received event network-vif-plugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5018894c-9c81-4d6f-8c8f-ac805d6530b7 req-b01302fc-3563-4d64-a9df-6aa4db7df552 service nova] Acquiring lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5018894c-9c81-4d6f-8c8f-ac805d6530b7 req-b01302fc-3563-4d64-a9df-6aa4db7df552 service nova] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5018894c-9c81-4d6f-8c8f-ac805d6530b7 req-b01302fc-3563-4d64-a9df-6aa4db7df552 service nova] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:10:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-5018894c-9c81-4d6f-8c8f-ac805d6530b7 req-b01302fc-3563-4d64-a9df-6aa4db7df552 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] No waiting events found dispatching network-vif-plugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:10:51 user nova-compute[76161]: WARNING nova.compute.manager [req-5018894c-9c81-4d6f-8c8f-ac805d6530b7 req-b01302fc-3563-4d64-a9df-6aa4db7df552 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Received unexpected event network-vif-plugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa for instance with vm_state active and task_state None.
Nov 14 18:10:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:10:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-edf1820c-76bd-46fd-a8dd-ab60be39a6cd req-5638ec15-bc8a-4a57-96d1-fbd9972d737c service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-changed-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:11:11 user nova-compute[76161]: DEBUG nova.compute.manager [req-edf1820c-76bd-46fd-a8dd-ab60be39a6cd req-5638ec15-bc8a-4a57-96d1-fbd9972d737c service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Refreshing instance network info cache due to event network-changed-99e841f1-c43d-40dc-9376-8f64d20e4f15. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:11:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-edf1820c-76bd-46fd-a8dd-ab60be39a6cd req-5638ec15-bc8a-4a57-96d1-fbd9972d737c service nova] Acquiring lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:11:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-edf1820c-76bd-46fd-a8dd-ab60be39a6cd req-5638ec15-bc8a-4a57-96d1-fbd9972d737c service nova] Acquired lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:11:11 user nova-compute[76161]: DEBUG nova.network.neutron [req-edf1820c-76bd-46fd-a8dd-ab60be39a6cd req-5638ec15-bc8a-4a57-96d1-fbd9972d737c service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Refreshing network info cache for port 99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:11:11 user nova-compute[76161]: DEBUG nova.network.neutron [req-edf1820c-76bd-46fd-a8dd-ab60be39a6cd req-5638ec15-bc8a-4a57-96d1-fbd9972d737c service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updated VIF entry in instance network info cache for port 99e841f1-c43d-40dc-9376-8f64d20e4f15. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:11:11 user nova-compute[76161]: DEBUG nova.network.neutron [req-edf1820c-76bd-46fd-a8dd-ab60be39a6cd req-5638ec15-bc8a-4a57-96d1-fbd9972d737c service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updating instance_info_cache with network_info: [{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:11:11 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-edf1820c-76bd-46fd-a8dd-ab60be39a6cd req-5638ec15-bc8a-4a57-96d1-fbd9972d737c service nova] Releasing lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:11:12 user nova-compute[76161]: DEBUG nova.compute.manager [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:11:12 user nova-compute[76161]: INFO nova.compute.manager [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] instance snapshotting
Nov 14 18:11:12 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Beginning live snapshot process
Nov 14 18:11:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json -f qcow2 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json -f qcow2 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:12 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.168s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfeucyjlg/35485d8a5783486f9323245abc4f33f7.delta 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:13 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfeucyjlg/35485d8a5783486f9323245abc4f33f7.delta 1073741824" returned: 0 in 0.045s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 18:11:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 18:11:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=76161) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 18:11:14 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 18:11:14 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 18:11:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfeucyjlg/35485d8a5783486f9323245abc4f33f7.delta /opt/stack/data/nova/instances/snapshots/tmpfeucyjlg/35485d8a5783486f9323245abc4f33f7 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfeucyjlg/35485d8a5783486f9323245abc4f33f7.delta /opt/stack/data/nova/instances/snapshots/tmpfeucyjlg/35485d8a5783486f9323245abc4f33f7" returned: 0 in 0.521s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:15 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Snapshot extracted, beginning image upload
Nov 14 18:11:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:17 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Snapshot image upload complete
Nov 14 18:11:17 user nova-compute[76161]: INFO nova.compute.manager [None req-da0072ce-7327-40be-9b56-d90c95395bd8 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Took 4.91 seconds to snapshot the instance on the hypervisor.
Nov 14 18:11:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:23 user nova-compute[76161]: INFO nova.compute.manager [None req-0e22853a-de41-4c26-9637-aa82b2fc4c75 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Unrescuing
Nov 14 18:11:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e22853a-de41-4c26-9637-aa82b2fc4c75 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:11:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e22853a-de41-4c26-9637-aa82b2fc4c75 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquired lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:11:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-0e22853a-de41-4c26-9637-aa82b2fc4c75 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG nova.network.neutron [None req-0e22853a-de41-4c26-9637-aa82b2fc4c75 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updating instance_info_cache with network_info: [{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-0e22853a-de41-4c26-9637-aa82b2fc4c75 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Releasing lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG nova.objects.instance [None req-0e22853a-de41-4c26-9637-aa82b2fc4c75 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'flavor' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-5c7987ab-eec4-41fe-8185-7565a0bdacdb req-32794bef-64f1-4b82-8141-04f5fc8f3a8f service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5c7987ab-eec4-41fe-8185-7565a0bdacdb req-32794bef-64f1-4b82-8141-04f5fc8f3a8f service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5c7987ab-eec4-41fe-8185-7565a0bdacdb req-32794bef-64f1-4b82-8141-04f5fc8f3a8f service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5c7987ab-eec4-41fe-8185-7565a0bdacdb req-32794bef-64f1-4b82-8141-04f5fc8f3a8f service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-5c7987ab-eec4-41fe-8185-7565a0bdacdb req-32794bef-64f1-4b82-8141-04f5fc8f3a8f service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:11:24 user nova-compute[76161]: WARNING nova.compute.manager [req-5c7987ab-eec4-41fe-8185-7565a0bdacdb req-32794bef-64f1-4b82-8141-04f5fc8f3a8f service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:11:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:25 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Instance destroyed successfully.
Nov 14 18:11:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-ec36d77f-52e6-4ec5-ae2e-2dfe6eddc6da req-3ade7d2f-1519-4070-8c53-6e2878757672 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:11:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ec36d77f-52e6-4ec5-ae2e-2dfe6eddc6da req-3ade7d2f-1519-4070-8c53-6e2878757672 service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ec36d77f-52e6-4ec5-ae2e-2dfe6eddc6da req-3ade7d2f-1519-4070-8c53-6e2878757672 service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ec36d77f-52e6-4ec5-ae2e-2dfe6eddc6da req-3ade7d2f-1519-4070-8c53-6e2878757672 service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-ec36d77f-52e6-4ec5-ae2e-2dfe6eddc6da req-3ade7d2f-1519-4070-8c53-6e2878757672 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:11:26 user nova-compute[76161]: WARNING nova.compute.manager [req-ec36d77f-52e6-4ec5-ae2e-2dfe6eddc6da req-3ade7d2f-1519-4070-8c53-6e2878757672 service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:11:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:11:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:11:28 user nova-compute[76161]: WARNING nova.compute.manager [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:11:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:11:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:11:28 user nova-compute[76161]: WARNING nova.compute.manager [req-40407b3e-8ee0-4420-b39a-abf26236087b req-b9e275c7-9caf-4d7a-ac8b-5e3ec8dff12f service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:11:29 user nova-compute[76161]: DEBUG nova.compute.manager [None req-0e22853a-de41-4c26-9637-aa82b2fc4c75 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Updating instance_info_cache with network_info: [{"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-de90c284-3d97-42c6-9692-cdac8eccd2ef" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:11:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:11:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:11:31 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:11:33 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:11:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:11:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:11:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:11:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:11:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:34 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:11:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:37 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:11:37 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8219MB free_disk=25.056697845458984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e4f6135c-879b-4a15-8798-b6d83e5823da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 30f22af1-c024-4da6-bf55-7fba565bd50b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e32b1199-adf6-42ad-9a73-692aeb5e22a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:11:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:11:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:11:41 user nova-compute[76161]: INFO nova.compute.claims [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Claim successful on node user
Nov 14 18:11:41 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG nova.compute.manager [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG nova.compute.manager [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG nova.network.neutron [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:11:41 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:11:41 user nova-compute[76161]: DEBUG nova.compute.manager [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG nova.policy [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd22a86988e6043d2ab950e0d6e557ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81682e21827c4572b1659004cc22215a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:11:41 user nova-compute[76161]: INFO nova.virt.block_device [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Booting with volume 78b45bd9-d89b-4ed9-a248-f2bebec9e71e at /dev/vda
Nov 14 18:11:41 user nova-compute[76161]: DEBUG os_brick.utils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ba1358-3593-40b8-9ce6-2a412878bbb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef08ee2b-b2d1-43e9-9d04-d03c0a26b161]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[def263c8-b849-4da5-92bb-d78b9acfa6ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2256bb4f-b7ce-4c52-a679-004cc3b2c0ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:11:41 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:11:41 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[291fe964-7358-4599-b312-a294daf447f8]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG os_brick.utils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:11:41 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Updating existing volume attachment record: 9e902da7-3a0f-42cb-956f-a312ecdb065c {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:11:42 user nova-compute[76161]: DEBUG nova.network.neutron [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Successfully created port: 48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG nova.network.neutron [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Successfully updated port: 48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "refresh_cache-09cc2918-c06d-4c20-bb2c-68f5e61382f1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquired lock "refresh_cache-09cc2918-c06d-4c20-bb2c-68f5e61382f1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG nova.network.neutron [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG nova.network.neutron [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG nova.compute.manager [req-71f70dea-6ca8-4ac7-ac4c-e6d9b4f03035 req-6d6211fc-9b9d-489a-8469-1f812b16b006 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received event network-changed-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG nova.compute.manager [req-71f70dea-6ca8-4ac7-ac4c-e6d9b4f03035 req-6d6211fc-9b9d-489a-8469-1f812b16b006 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Refreshing instance network info cache due to event network-changed-48a27c1a-149e-4bb2-9a10-11ee5274e349. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-71f70dea-6ca8-4ac7-ac4c-e6d9b4f03035 req-6d6211fc-9b9d-489a-8469-1f812b16b006 service nova] Acquiring lock "refresh_cache-09cc2918-c06d-4c20-bb2c-68f5e61382f1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG nova.network.neutron [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Updating instance_info_cache with network_info: [{"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Releasing lock "refresh_cache-09cc2918-c06d-4c20-bb2c-68f5e61382f1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG nova.compute.manager [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Instance network_info: |[{"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-71f70dea-6ca8-4ac7-ac4c-e6d9b4f03035 req-6d6211fc-9b9d-489a-8469-1f812b16b006 service nova] Acquired lock "refresh_cache-09cc2918-c06d-4c20-bb2c-68f5e61382f1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG nova.network.neutron [req-71f70dea-6ca8-4ac7-ac4c-e6d9b4f03035 req-6d6211fc-9b9d-489a-8469-1f812b16b006 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Refreshing network info cache for port 48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:11:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:44 user nova-compute[76161]: DEBUG nova.network.neutron [req-71f70dea-6ca8-4ac7-ac4c-e6d9b4f03035 req-6d6211fc-9b9d-489a-8469-1f812b16b006 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Updated VIF entry in instance network info cache for port 48a27c1a-149e-4bb2-9a10-11ee5274e349. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:11:44 user nova-compute[76161]: DEBUG nova.network.neutron [req-71f70dea-6ca8-4ac7-ac4c-e6d9b4f03035 req-6d6211fc-9b9d-489a-8469-1f812b16b006 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Updating instance_info_cache with network_info: [{"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:11:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-71f70dea-6ca8-4ac7-ac4c-e6d9b4f03035 req-6d6211fc-9b9d-489a-8469-1f812b16b006 service nova] Releasing lock "refresh_cache-09cc2918-c06d-4c20-bb2c-68f5e61382f1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:11:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:11:46 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Creating image(s)
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Ensure instance console log exists: /opt/stack/data/nova/instances/09cc2918-c06d-4c20-bb2c-68f5e61382f1/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Start _get_guest_xml network_info=[{"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnCHeIof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '09cc2918-c06d-4c20-bb2c-68f5e61382f1', 'attached_at': '', 'detached_at': '', 'volume_id': '78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 'serial': '78b45bd9-d89b-4ed9-a248-f2bebec9e71e'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '9e902da7-3a0f-42cb-956f-a312ecdb065c', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:11:46 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:11:46 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnCHeIof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:11:46 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:11:46 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:11:46 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b105cc-c018-41af-a879-7636249d9e7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:11:46 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0676184-a27e-4b81-be63-608a62c91bf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e] added
Nov 14 18:11:46 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a73158e-24c8-4d80-8b7e-dd84e772141d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae0afc8-eeb0-4a3e-9739-0370dc61f8ca]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnCHeIof {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnCHeIof" returned: 0 in 0.040s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[634b5e94-7de5-494b-ac6f-71b9e5acdf10]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UnCHeIof'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f9e68b-5b52-4485-9e51-470ca6da7b82]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc76370-d3e2-447a-aa89-8197b4c87234]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:11:46 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:11:46 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b828318-f6a3-45b3-adaf-cd86a5c91ed5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260]
Nov 14 18:11:46 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260] successful.
Nov 14 18:11:46 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f2adac-2400-4651-9923-c1d6a495f01c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e7871-c607-471b-90ca-490f761b3af6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:11:46 user nova-compute[76161]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:11:46 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:11:46 user nova-compute[76161]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:11:46 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[978c15f8-d5f4-4c6d-9b88-27209024bf91]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:11:46 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnCHeIof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:11:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:11:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23232653930646462', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:11:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232653930646462', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-630729042',display_name='tempest-TestVolumeBootPattern-server-630729042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-630729042',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHVYDN2Xftf5V1grXUvkOAuZ4lRy2Yu8x71x7XZMVIMR4I5qKGZtkFKrVxApclfxwZHmCeNjcLNUIFGzVbzrwECoYdV2hlra8hiYCIDqSv04geiOynO7IsegUM2gQdCg==',key_name='tempest-TestVolumeBootPattern-706510423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-fkgyd2mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:11:42Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=09cc2918-c06d-4c20-bb2c-68f5e61382f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c6:14,bridge_name='br-int',has_traffic_filtering=True,id=48a27c1a-149e-4bb2-9a10-11ee5274e349,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a27c1a-14') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG nova.objects.instance [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'pci_devices' on Instance uuid 09cc2918-c06d-4c20-bb2c-68f5e61382f1 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:11:48 user nova-compute[76161]:   <uuid>09cc2918-c06d-4c20-bb2c-68f5e61382f1</uuid>
Nov 14 18:11:48 user nova-compute[76161]:   <name>instance-0000002e</name>
Nov 14 18:11:48 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:11:48 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:11:48 user nova-compute[76161]:   <metadata>
Nov 14 18:11:48 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:11:48 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:11:48 user nova-compute[76161]:       <nova:name>tempest-TestVolumeBootPattern-server-630729042</nova:name>
Nov 14 18:11:48 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:11:46</nova:creationTime>
Nov 14 18:11:48 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:11:48 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:11:48 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:11:48 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:11:48 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:11:48 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:11:48 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:11:48 user nova-compute[76161]:       <nova:owner>
Nov 14 18:11:48 user nova-compute[76161]:         <nova:user uuid="d22a86988e6043d2ab950e0d6e557ef8">tempest-TestVolumeBootPattern-1727647616-project-member</nova:user>
Nov 14 18:11:48 user nova-compute[76161]:         <nova:project uuid="81682e21827c4572b1659004cc22215a">tempest-TestVolumeBootPattern-1727647616</nova:project>
Nov 14 18:11:48 user nova-compute[76161]:       </nova:owner>
Nov 14 18:11:48 user nova-compute[76161]:       <nova:ports>
Nov 14 18:11:48 user nova-compute[76161]:         <nova:port uuid="48a27c1a-149e-4bb2-9a10-11ee5274e349">
Nov 14 18:11:48 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 18:11:48 user nova-compute[76161]:         </nova:port>
Nov 14 18:11:48 user nova-compute[76161]:       </nova:ports>
Nov 14 18:11:48 user nova-compute[76161]:     </nova:instance>
Nov 14 18:11:48 user nova-compute[76161]:   </metadata>
Nov 14 18:11:48 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:11:48 user nova-compute[76161]:     <system>
Nov 14 18:11:48 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:11:48 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:11:48 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:11:48 user nova-compute[76161]:       <entry name="serial">09cc2918-c06d-4c20-bb2c-68f5e61382f1</entry>
Nov 14 18:11:48 user nova-compute[76161]:       <entry name="uuid">09cc2918-c06d-4c20-bb2c-68f5e61382f1</entry>
Nov 14 18:11:48 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:11:48 user nova-compute[76161]:     </system>
Nov 14 18:11:48 user nova-compute[76161]:   </sysinfo>
Nov 14 18:11:48 user nova-compute[76161]:   <os>
Nov 14 18:11:48 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:11:48 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:11:48 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:11:48 user nova-compute[76161]:   </os>
Nov 14 18:11:48 user nova-compute[76161]:   <features>
Nov 14 18:11:48 user nova-compute[76161]:     <acpi/>
Nov 14 18:11:48 user nova-compute[76161]:     <apic/>
Nov 14 18:11:48 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:11:48 user nova-compute[76161]:   </features>
Nov 14 18:11:48 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:11:48 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:11:48 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:11:48 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:11:48 user nova-compute[76161]:   </clock>
Nov 14 18:11:48 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:11:48 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:11:48 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:11:48 user nova-compute[76161]:   </cpu>
Nov 14 18:11:48 user nova-compute[76161]:   <devices>
Nov 14 18:11:48 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:11:48 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:11:48 user nova-compute[76161]:       <source dev="/dev/sdb"/>
Nov 14 18:11:48 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:11:48 user nova-compute[76161]:       <serial>78b45bd9-d89b-4ed9-a248-f2bebec9e71e</serial>
Nov 14 18:11:48 user nova-compute[76161]:     </disk>
Nov 14 18:11:48 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:11:48 user nova-compute[76161]:       <mac address="fa:16:3e:d3:c6:14"/>
Nov 14 18:11:48 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:11:48 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:11:48 user nova-compute[76161]:       <target dev="tap48a27c1a-14"/>
Nov 14 18:11:48 user nova-compute[76161]:     </interface>
Nov 14 18:11:48 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:11:48 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/09cc2918-c06d-4c20-bb2c-68f5e61382f1/console.log" append="off"/>
Nov 14 18:11:48 user nova-compute[76161]:     </serial>
Nov 14 18:11:48 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:11:48 user nova-compute[76161]:     <video>
Nov 14 18:11:48 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:11:48 user nova-compute[76161]:     </video>
Nov 14 18:11:48 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:11:48 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:11:48 user nova-compute[76161]:     </rng>
Nov 14 18:11:48 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:11:48 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:11:48 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:11:48 user nova-compute[76161]:     </memballoon>
Nov 14 18:11:48 user nova-compute[76161]:   </devices>
Nov 14 18:11:48 user nova-compute[76161]: </domain>
Nov 14 18:11:48 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-630729042',display_name='tempest-TestVolumeBootPattern-server-630729042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-630729042',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHVYDN2Xftf5V1grXUvkOAuZ4lRy2Yu8x71x7XZMVIMR4I5qKGZtkFKrVxApclfxwZHmCeNjcLNUIFGzVbzrwECoYdV2hlra8hiYCIDqSv04geiOynO7IsegUM2gQdCg==',key_name='tempest-TestVolumeBootPattern-706510423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-fkgyd2mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:11:42Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=09cc2918-c06d-4c20-bb2c-68f5e61382f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c6:14,bridge_name='br-int',has_traffic_filtering=True,id=48a27c1a-149e-4bb2-9a10-11ee5274e349,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a27c1a-14') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG os_vif [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c6:14,bridge_name='br-int',has_traffic_filtering=True,id=48a27c1a-149e-4bb2-9a10-11ee5274e349,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a27c1a-14') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5f4cb46-0495-5de7-a8b2-e529a339f66b', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48a27c1a-14, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48a27c1a-14, col_values=(('qos', UUID('6b162e13-055d-471e-b748-da96010ae794')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48a27c1a-14, col_values=(('external_ids', {'iface-id': '48a27c1a-149e-4bb2-9a10-11ee5274e349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:c6:14', 'vm-uuid': '09cc2918-c06d-4c20-bb2c-68f5e61382f1'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:48 user nova-compute[76161]: INFO os_vif [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c6:14,bridge_name='br-int',has_traffic_filtering=True,id=48a27c1a-149e-4bb2-9a10-11ee5274e349,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a27c1a-14')
Nov 14 18:11:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No VIF found with MAC fa:16:3e:d3:c6:14, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:11:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-7bb900d4-2839-40b9-9168-6c5a39ed4632 req-c3f38e6c-3bb7-4f18-86a7-8217521f213c service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received event network-vif-plugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:11:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7bb900d4-2839-40b9-9168-6c5a39ed4632 req-c3f38e6c-3bb7-4f18-86a7-8217521f213c service nova] Acquiring lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7bb900d4-2839-40b9-9168-6c5a39ed4632 req-c3f38e6c-3bb7-4f18-86a7-8217521f213c service nova] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7bb900d4-2839-40b9-9168-6c5a39ed4632 req-c3f38e6c-3bb7-4f18-86a7-8217521f213c service nova] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-7bb900d4-2839-40b9-9168-6c5a39ed4632 req-c3f38e6c-3bb7-4f18-86a7-8217521f213c service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] No waiting events found dispatching network-vif-plugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:11:49 user nova-compute[76161]: WARNING nova.compute.manager [req-7bb900d4-2839-40b9-9168-6c5a39ed4632 req-c3f38e6c-3bb7-4f18-86a7-8217521f213c service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received unexpected event network-vif-plugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 for instance with vm_state building and task_state spawning.
Nov 14 18:11:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:11:51 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Instance spawned successfully.
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-cb922886-8f7a-41af-8c42-bb1292864da1 req-df8fba97-db30-41b1-8186-66fe6e0b9a81 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received event network-vif-plugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cb922886-8f7a-41af-8c42-bb1292864da1 req-df8fba97-db30-41b1-8186-66fe6e0b9a81 service nova] Acquiring lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cb922886-8f7a-41af-8c42-bb1292864da1 req-df8fba97-db30-41b1-8186-66fe6e0b9a81 service nova] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cb922886-8f7a-41af-8c42-bb1292864da1 req-df8fba97-db30-41b1-8186-66fe6e0b9a81 service nova] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-cb922886-8f7a-41af-8c42-bb1292864da1 req-df8fba97-db30-41b1-8186-66fe6e0b9a81 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] No waiting events found dispatching network-vif-plugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:11:51 user nova-compute[76161]: WARNING nova.compute.manager [req-cb922886-8f7a-41af-8c42-bb1292864da1 req-df8fba97-db30-41b1-8186-66fe6e0b9a81 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received unexpected event network-vif-plugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 for instance with vm_state building and task_state spawning.
Nov 14 18:11:51 user nova-compute[76161]: INFO nova.compute.manager [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 14 18:11:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:11:51 user nova-compute[76161]: INFO nova.compute.manager [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Took 10.78 seconds to build instance.
Nov 14 18:11:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-016e2634-c136-404d-97b4-e033eb20916b tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.871s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:11:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:11:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:01 user nova-compute[76161]: INFO nova.compute.manager [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Terminating instance
Nov 14 18:12:01 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-c1f98376-748b-48f7-917f-efe0544ea186 req-d7aff901-1f55-4aca-aed9-5cb27e307084 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-unplugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c1f98376-748b-48f7-917f-efe0544ea186 req-d7aff901-1f55-4aca-aed9-5cb27e307084 service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c1f98376-748b-48f7-917f-efe0544ea186 req-d7aff901-1f55-4aca-aed9-5cb27e307084 service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c1f98376-748b-48f7-917f-efe0544ea186 req-d7aff901-1f55-4aca-aed9-5cb27e307084 service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-c1f98376-748b-48f7-917f-efe0544ea186 req-d7aff901-1f55-4aca-aed9-5cb27e307084 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-unplugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:12:01 user nova-compute[76161]: DEBUG nova.compute.manager [req-c1f98376-748b-48f7-917f-efe0544ea186 req-d7aff901-1f55-4aca-aed9-5cb27e307084 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-unplugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Instance destroyed successfully.
Nov 14 18:12:02 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lazy-loading 'resources' on Instance uuid 30f22af1-c024-4da6-bf55-7fba565bd50b {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1109152857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1109152857',id=40,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2NrH89/xsrXPPHHpfe9xbUselmuX915kYvkiHsNDk/HGgGXPKFEZCO4dEkj3yYeaW8Gko12Y2GSDL2vNeUvyfj7Ova4pX5Y2tpWfReAklnKCXZB0RfvANMe0KAvhs37g==',key_name='tempest-keypair-2021075801',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:10:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e77e9d3740940e6b3c3bbcb66281cdd',ramdisk_id='',reservation_id='r-2okswtgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1624203066',owner_user_name='tempest-AttachVolumeShelveTestJSON-1624203066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cee653d6630641b89a074a31d8ddddbc',uuid=30f22af1-c024-4da6-bf55-7fba565bd50b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converting VIF {"id": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "address": "fa:16:3e:d6:60:96", "network": {"id": "7efe3772-7ac9-4cd0-a6c2-e34a44efa229", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-556761001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e77e9d3740940e6b3c3bbcb66281cdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3148c108-da", "ovs_interfaceid": "3148c108-daab-4928-8c8c-35ed2c11a9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG os_vif [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3148c108-da, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31a55de9-8225-40aa-837b-0b79e134c6d8) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:02 user nova-compute[76161]: INFO os_vif [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:60:96,bridge_name='br-int',has_traffic_filtering=True,id=3148c108-daab-4928-8c8c-35ed2c11a9bc,network=Network(7efe3772-7ac9-4cd0-a6c2-e34a44efa229),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3148c108-da')
Nov 14 18:12:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Deleting instance files /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b_del
Nov 14 18:12:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Deletion of /opt/stack/data/nova/instances/30f22af1-c024-4da6-bf55-7fba565bd50b_del complete
Nov 14 18:12:02 user nova-compute[76161]: INFO nova.compute.manager [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 18:12:02 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:12:02 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:12:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:03 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:12:03 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Took 1.16 seconds to deallocate network for instance.
Nov 14 18:12:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-c8582412-0c58-43eb-bf37-b242492368ba req-6b606c82-6a80-4cdd-9b46-7ca85aa69be9 service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-deleted-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:03 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:12:03 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:12:04 user nova-compute[76161]: WARNING nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state deleted and task_state None.
Nov 14 18:12:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:12:04 user nova-compute[76161]: WARNING nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state deleted and task_state None.
Nov 14 18:12:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:12:04 user nova-compute[76161]: WARNING nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state deleted and task_state None.
Nov 14 18:12:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-unplugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-unplugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:12:04 user nova-compute[76161]: WARNING nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-unplugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state deleted and task_state None.
Nov 14 18:12:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Acquiring lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] No waiting events found dispatching network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:12:04 user nova-compute[76161]: WARNING nova.compute.manager [req-19ad3550-e9db-4732-8239-2f595f1744d4 req-072c77e9-910a-4c76-81a2-7cadd832c09f service nova] [instance: 30f22af1-c024-4da6-bf55-7fba565bd50b] Received unexpected event network-vif-plugged-3148c108-daab-4928-8c8c-35ed2c11a9bc for instance with vm_state deleted and task_state None.
Nov 14 18:12:04 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Deleted allocations for instance 30f22af1-c024-4da6-bf55-7fba565bd50b
Nov 14 18:12:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7f7b57e1-1066-4ccd-9f29-b31c9d665fb4 tempest-AttachVolumeShelveTestJSON-1624203066 tempest-AttachVolumeShelveTestJSON-1624203066-project-member] Lock "30f22af1-c024-4da6-bf55-7fba565bd50b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.546s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "7949bb9d-dd78-4017-b19d-9081ff68c700" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:12:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:12:15 user nova-compute[76161]: INFO nova.compute.claims [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Claim successful on node user
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:12:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.policy [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f74d7304b3e40c389c28e84361ce1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64059d5429f2468f8dbcc256a47a5957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:12:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Creating image(s)
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "/opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "/opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "/opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk 1073741824" returned: 0 in 0.046s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Successfully created port: ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:12:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Cannot resize image /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Ensure instance console log exists: /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Successfully updated port: ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "refresh_cache-7949bb9d-dd78-4017-b19d-9081ff68c700" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquired lock "refresh_cache-7949bb9d-dd78-4017-b19d-9081ff68c700" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-115d79e7-255a-408b-9b0e-798f1c304db9 req-ae72ae0d-9316-46a9-9a9f-286e7adbcf68 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Received event network-changed-ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-115d79e7-255a-408b-9b0e-798f1c304db9 req-ae72ae0d-9316-46a9-9a9f-286e7adbcf68 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Refreshing instance network info cache due to event network-changed-ae359a31-0dfc-4329-b089-9ce0c04192fa. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-115d79e7-255a-408b-9b0e-798f1c304db9 req-ae72ae0d-9316-46a9-9a9f-286e7adbcf68 service nova] Acquiring lock "refresh_cache-7949bb9d-dd78-4017-b19d-9081ff68c700" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Updating instance_info_cache with network_info: [{"id": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "address": "fa:16:3e:ad:53:75", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae359a31-0d", "ovs_interfaceid": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Releasing lock "refresh_cache-7949bb9d-dd78-4017-b19d-9081ff68c700" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Instance network_info: |[{"id": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "address": "fa:16:3e:ad:53:75", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae359a31-0d", "ovs_interfaceid": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-115d79e7-255a-408b-9b0e-798f1c304db9 req-ae72ae0d-9316-46a9-9a9f-286e7adbcf68 service nova] Acquired lock "refresh_cache-7949bb9d-dd78-4017-b19d-9081ff68c700" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-115d79e7-255a-408b-9b0e-798f1c304db9 req-ae72ae0d-9316-46a9-9a9f-286e7adbcf68 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Refreshing network info cache for port ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Start _get_guest_xml network_info=[{"id": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "address": "fa:16:3e:ad:53:75", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae359a31-0d", "ovs_interfaceid": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:12:17 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:12:17 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:12:17 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:12:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-161431581',display_name='tempest-VolumesActionsTest-instance-161431581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-161431581',id=47,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64059d5429f2468f8dbcc256a47a5957',ramdisk_id='',reservation_id='r-em9qgrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1577186745',owner_user_name='tempest-VolumesActionsTest-1577186745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:12:16Z,user_data=None,user_id='0f74d7304b3e40c389c28e84361ce1a0',uuid=7949bb9d-dd78-4017-b19d-9081ff68c700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "address": "fa:16:3e:ad:53:75", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae359a31-0d", "ovs_interfaceid": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converting VIF {"id": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "address": "fa:16:3e:ad:53:75", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae359a31-0d", "ovs_interfaceid": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:53:75,bridge_name='br-int',has_traffic_filtering=True,id=ae359a31-0dfc-4329-b089-9ce0c04192fa,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae359a31-0d') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lazy-loading 'pci_devices' on Instance uuid 7949bb9d-dd78-4017-b19d-9081ff68c700 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:12:18 user nova-compute[76161]:   <uuid>7949bb9d-dd78-4017-b19d-9081ff68c700</uuid>
Nov 14 18:12:18 user nova-compute[76161]:   <name>instance-0000002f</name>
Nov 14 18:12:18 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:12:18 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:12:18 user nova-compute[76161]:   <metadata>
Nov 14 18:12:18 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:12:18 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:12:18 user nova-compute[76161]:       <nova:name>tempest-VolumesActionsTest-instance-161431581</nova:name>
Nov 14 18:12:18 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:12:17</nova:creationTime>
Nov 14 18:12:18 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:12:18 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:12:18 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:12:18 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:12:18 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:12:18 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:12:18 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:12:18 user nova-compute[76161]:       <nova:owner>
Nov 14 18:12:18 user nova-compute[76161]:         <nova:user uuid="0f74d7304b3e40c389c28e84361ce1a0">tempest-VolumesActionsTest-1577186745-project-member</nova:user>
Nov 14 18:12:18 user nova-compute[76161]:         <nova:project uuid="64059d5429f2468f8dbcc256a47a5957">tempest-VolumesActionsTest-1577186745</nova:project>
Nov 14 18:12:18 user nova-compute[76161]:       </nova:owner>
Nov 14 18:12:18 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:12:18 user nova-compute[76161]:       <nova:ports>
Nov 14 18:12:18 user nova-compute[76161]:         <nova:port uuid="ae359a31-0dfc-4329-b089-9ce0c04192fa">
Nov 14 18:12:18 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 18:12:18 user nova-compute[76161]:         </nova:port>
Nov 14 18:12:18 user nova-compute[76161]:       </nova:ports>
Nov 14 18:12:18 user nova-compute[76161]:     </nova:instance>
Nov 14 18:12:18 user nova-compute[76161]:   </metadata>
Nov 14 18:12:18 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:12:18 user nova-compute[76161]:     <system>
Nov 14 18:12:18 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:12:18 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:12:18 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:12:18 user nova-compute[76161]:       <entry name="serial">7949bb9d-dd78-4017-b19d-9081ff68c700</entry>
Nov 14 18:12:18 user nova-compute[76161]:       <entry name="uuid">7949bb9d-dd78-4017-b19d-9081ff68c700</entry>
Nov 14 18:12:18 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:12:18 user nova-compute[76161]:     </system>
Nov 14 18:12:18 user nova-compute[76161]:   </sysinfo>
Nov 14 18:12:18 user nova-compute[76161]:   <os>
Nov 14 18:12:18 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:12:18 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:12:18 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:12:18 user nova-compute[76161]:   </os>
Nov 14 18:12:18 user nova-compute[76161]:   <features>
Nov 14 18:12:18 user nova-compute[76161]:     <acpi/>
Nov 14 18:12:18 user nova-compute[76161]:     <apic/>
Nov 14 18:12:18 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:12:18 user nova-compute[76161]:   </features>
Nov 14 18:12:18 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:12:18 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:12:18 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:12:18 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:12:18 user nova-compute[76161]:   </clock>
Nov 14 18:12:18 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:12:18 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:12:18 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:12:18 user nova-compute[76161]:   </cpu>
Nov 14 18:12:18 user nova-compute[76161]:   <devices>
Nov 14 18:12:18 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:12:18 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:12:18 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk"/>
Nov 14 18:12:18 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:12:18 user nova-compute[76161]:     </disk>
Nov 14 18:12:18 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:12:18 user nova-compute[76161]:       <mac address="fa:16:3e:ad:53:75"/>
Nov 14 18:12:18 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:12:18 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:12:18 user nova-compute[76161]:       <target dev="tapae359a31-0d"/>
Nov 14 18:12:18 user nova-compute[76161]:     </interface>
Nov 14 18:12:18 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:12:18 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/console.log" append="off"/>
Nov 14 18:12:18 user nova-compute[76161]:     </serial>
Nov 14 18:12:18 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:12:18 user nova-compute[76161]:     <video>
Nov 14 18:12:18 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:12:18 user nova-compute[76161]:     </video>
Nov 14 18:12:18 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:12:18 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:12:18 user nova-compute[76161]:     </rng>
Nov 14 18:12:18 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:12:18 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:12:18 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:12:18 user nova-compute[76161]:     </memballoon>
Nov 14 18:12:18 user nova-compute[76161]:   </devices>
Nov 14 18:12:18 user nova-compute[76161]: </domain>
Nov 14 18:12:18 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:12:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-161431581',display_name='tempest-VolumesActionsTest-instance-161431581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-161431581',id=47,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64059d5429f2468f8dbcc256a47a5957',ramdisk_id='',reservation_id='r-em9qgrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1577186745',owner_user_name='tempest-VolumesActionsTest-1577186745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:12:16Z,user_data=None,user_id='0f74d7304b3e40c389c28e84361ce1a0',uuid=7949bb9d-dd78-4017-b19d-9081ff68c700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "address": "fa:16:3e:ad:53:75", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae359a31-0d", "ovs_interfaceid": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converting VIF {"id": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "address": "fa:16:3e:ad:53:75", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae359a31-0d", "ovs_interfaceid": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:53:75,bridge_name='br-int',has_traffic_filtering=True,id=ae359a31-0dfc-4329-b089-9ce0c04192fa,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae359a31-0d') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG os_vif [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:53:75,bridge_name='br-int',has_traffic_filtering=True,id=ae359a31-0dfc-4329-b089-9ce0c04192fa,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae359a31-0d') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89616f28-41bd-5e74-9801-7a918d84f86d', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae359a31-0d, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae359a31-0d, col_values=(('qos', UUID('33f26c9e-3cbb-4628-90c4-f99ad56dc0e7')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae359a31-0d, col_values=(('external_ids', {'iface-id': 'ae359a31-0dfc-4329-b089-9ce0c04192fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:53:75', 'vm-uuid': '7949bb9d-dd78-4017-b19d-9081ff68c700'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:18 user nova-compute[76161]: INFO os_vif [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:53:75,bridge_name='br-int',has_traffic_filtering=True,id=ae359a31-0dfc-4329-b089-9ce0c04192fa,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae359a31-0d')
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] No VIF found with MAC fa:16:3e:ad:53:75, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.network.neutron [req-115d79e7-255a-408b-9b0e-798f1c304db9 req-ae72ae0d-9316-46a9-9a9f-286e7adbcf68 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Updated VIF entry in instance network info cache for port ae359a31-0dfc-4329-b089-9ce0c04192fa. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG nova.network.neutron [req-115d79e7-255a-408b-9b0e-798f1c304db9 req-ae72ae0d-9316-46a9-9a9f-286e7adbcf68 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Updating instance_info_cache with network_info: [{"id": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "address": "fa:16:3e:ad:53:75", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae359a31-0d", "ovs_interfaceid": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:12:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-115d79e7-255a-408b-9b0e-798f1c304db9 req-ae72ae0d-9316-46a9-9a9f-286e7adbcf68 service nova] Releasing lock "refresh_cache-7949bb9d-dd78-4017-b19d-9081ff68c700" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:12:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-cb7c1af8-2d52-4728-9ff9-683e521fce9b req-eae0328f-0193-4b91-8bca-c230e0c7a2f6 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Received event network-vif-plugged-ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cb7c1af8-2d52-4728-9ff9-683e521fce9b req-eae0328f-0193-4b91-8bca-c230e0c7a2f6 service nova] Acquiring lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cb7c1af8-2d52-4728-9ff9-683e521fce9b req-eae0328f-0193-4b91-8bca-c230e0c7a2f6 service nova] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cb7c1af8-2d52-4728-9ff9-683e521fce9b req-eae0328f-0193-4b91-8bca-c230e0c7a2f6 service nova] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-cb7c1af8-2d52-4728-9ff9-683e521fce9b req-eae0328f-0193-4b91-8bca-c230e0c7a2f6 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] No waiting events found dispatching network-vif-plugged-ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:12:19 user nova-compute[76161]: WARNING nova.compute.manager [req-cb7c1af8-2d52-4728-9ff9-683e521fce9b req-eae0328f-0193-4b91-8bca-c230e0c7a2f6 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Received unexpected event network-vif-plugged-ae359a31-0dfc-4329-b089-9ce0c04192fa for instance with vm_state building and task_state spawning.
Nov 14 18:12:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:12:21 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Instance spawned successfully.
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:12:21 user nova-compute[76161]: INFO nova.compute.manager [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-f9bc11bb-e790-4b63-a71c-e26b732bef95 req-ba567c60-5c67-49ca-ac67-5078024580dd service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Received event network-vif-plugged-ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f9bc11bb-e790-4b63-a71c-e26b732bef95 req-ba567c60-5c67-49ca-ac67-5078024580dd service nova] Acquiring lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f9bc11bb-e790-4b63-a71c-e26b732bef95 req-ba567c60-5c67-49ca-ac67-5078024580dd service nova] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f9bc11bb-e790-4b63-a71c-e26b732bef95 req-ba567c60-5c67-49ca-ac67-5078024580dd service nova] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-f9bc11bb-e790-4b63-a71c-e26b732bef95 req-ba567c60-5c67-49ca-ac67-5078024580dd service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] No waiting events found dispatching network-vif-plugged-ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:12:21 user nova-compute[76161]: WARNING nova.compute.manager [req-f9bc11bb-e790-4b63-a71c-e26b732bef95 req-ba567c60-5c67-49ca-ac67-5078024580dd service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Received unexpected event network-vif-plugged-ae359a31-0dfc-4329-b089-9ce0c04192fa for instance with vm_state building and task_state spawning.
Nov 14 18:12:21 user nova-compute[76161]: INFO nova.compute.manager [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Took 5.97 seconds to build instance.
Nov 14 18:12:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8caf56ba-d2c3-4bdc-9a38-70491f47d579 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.061s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updating instance_info_cache with network_info: [{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:12:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:31 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:12:31 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:12:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Acquiring lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Acquiring lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:34 user nova-compute[76161]: INFO nova.compute.manager [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Terminating instance
Nov 14 18:12:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-aa443c9b-f9ea-4b8e-8225-0cf2631d55f3 req-815a21cd-27f4-4d3f-89e7-8e38f8066da0 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Received event network-vif-unplugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aa443c9b-f9ea-4b8e-8225-0cf2631d55f3 req-815a21cd-27f4-4d3f-89e7-8e38f8066da0 service nova] Acquiring lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aa443c9b-f9ea-4b8e-8225-0cf2631d55f3 req-815a21cd-27f4-4d3f-89e7-8e38f8066da0 service nova] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aa443c9b-f9ea-4b8e-8225-0cf2631d55f3 req-815a21cd-27f4-4d3f-89e7-8e38f8066da0 service nova] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-aa443c9b-f9ea-4b8e-8225-0cf2631d55f3 req-815a21cd-27f4-4d3f-89e7-8e38f8066da0 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] No waiting events found dispatching network-vif-unplugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-aa443c9b-f9ea-4b8e-8225-0cf2631d55f3 req-815a21cd-27f4-4d3f-89e7-8e38f8066da0 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Received event network-vif-unplugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:35 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Instance destroyed successfully.
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lazy-loading 'resources' on Instance uuid e32b1199-adf6-42ad-9a73-692aeb5e22a2 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-716323715',display_name='tempest-VolumesNegativeTest-instance-716323715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-716323715',id=45,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:10:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7ecb05577514b548ec317e2cc01e1e3',ramdisk_id='',reservation_id='r-3855ambi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-785450454',owner_user_name='tempest-VolumesNegativeTest-785450454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:10:52Z,user_data=None,user_id='1031c39ae143468b98f600d791424eac',uuid=e32b1199-adf6-42ad-9a73-692aeb5e22a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "address": "fa:16:3e:6c:95:30", "network": {"id": "331573ee-39a3-4a1a-bf94-bdf83b8761b2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5959f76ddcb0476184d4947075ac629a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac79aa2-ef", "ovs_interfaceid": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Converting VIF {"id": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "address": "fa:16:3e:6c:95:30", "network": {"id": "331573ee-39a3-4a1a-bf94-bdf83b8761b2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5959f76ddcb0476184d4947075ac629a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdac79aa2-ef", "ovs_interfaceid": "dac79aa2-eff8-454f-89ff-7452f58bf4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:95:30,bridge_name='br-int',has_traffic_filtering=True,id=dac79aa2-eff8-454f-89ff-7452f58bf4aa,network=Network(331573ee-39a3-4a1a-bf94-bdf83b8761b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac79aa2-ef') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG os_vif [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:95:30,bridge_name='br-int',has_traffic_filtering=True,id=dac79aa2-eff8-454f-89ff-7452f58bf4aa,network=Network(331573ee-39a3-4a1a-bf94-bdf83b8761b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac79aa2-ef') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdac79aa2-ef, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7e55a01-fc00-4337-b97e-0ff4e5064b5f) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:12:35 user nova-compute[76161]: INFO os_vif [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:95:30,bridge_name='br-int',has_traffic_filtering=True,id=dac79aa2-eff8-454f-89ff-7452f58bf4aa,network=Network(331573ee-39a3-4a1a-bf94-bdf83b8761b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdac79aa2-ef')
Nov 14 18:12:35 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Deleting instance files /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2_del
Nov 14 18:12:35 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Deletion of /opt/stack/data/nova/instances/e32b1199-adf6-42ad-9a73-692aeb5e22a2_del complete
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:35 user nova-compute[76161]: INFO nova.compute.manager [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG nova.compute.manager [req-3831cd1a-685a-4747-bd80-90eef5fd6be6 req-ee01119b-d02b-4a5f-9641-549c96d4f49d service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Received event network-vif-deleted-dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:36 user nova-compute[76161]: INFO nova.compute.manager [req-3831cd1a-685a-4747-bd80-90eef5fd6be6 req-ee01119b-d02b-4a5f-9641-549c96d4f49d service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Neutron deleted interface dac79aa2-eff8-454f-89ff-7452f58bf4aa; detaching it from the instance and deleting it from the info cache
Nov 14 18:12:36 user nova-compute[76161]: DEBUG nova.network.neutron [req-3831cd1a-685a-4747-bd80-90eef5fd6be6 req-ee01119b-d02b-4a5f-9641-549c96d4f49d service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG nova.compute.manager [req-3831cd1a-685a-4747-bd80-90eef5fd6be6 req-ee01119b-d02b-4a5f-9641-549c96d4f49d service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Detach interface failed, port_id=dac79aa2-eff8-454f-89ff-7452f58bf4aa, reason: Instance e32b1199-adf6-42ad-9a73-692aeb5e22a2 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 18:12:36 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Took 0.63 seconds to deallocate network for instance.
Nov 14 18:12:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:12:36 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Error from libvirt while getting description of instance-0000002d: [Error Code 42] Domain not found: no domain with matching uuid 'e32b1199-adf6-42ad-9a73-692aeb5e22a2' (instance-0000002d): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e32b1199-adf6-42ad-9a73-692aeb5e22a2' (instance-0000002d)
Nov 14 18:12:36 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:12:36 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:12:36 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:12:36 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8078MB free_disk=25.078857421875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.635s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.055s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:37 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Deleted allocations for instance e32b1199-adf6-42ad-9a73-692aeb5e22a2
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-433d55b7-7a11-4495-9428-871411fd8cd9 req-e25cc354-9dce-4a39-9ca3-32b299701491 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Received event network-vif-plugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-433d55b7-7a11-4495-9428-871411fd8cd9 req-e25cc354-9dce-4a39-9ca3-32b299701491 service nova] Acquiring lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-433d55b7-7a11-4495-9428-871411fd8cd9 req-e25cc354-9dce-4a39-9ca3-32b299701491 service nova] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-433d55b7-7a11-4495-9428-871411fd8cd9 req-e25cc354-9dce-4a39-9ca3-32b299701491 service nova] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.manager [req-433d55b7-7a11-4495-9428-871411fd8cd9 req-e25cc354-9dce-4a39-9ca3-32b299701491 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] No waiting events found dispatching network-vif-plugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:12:37 user nova-compute[76161]: WARNING nova.compute.manager [req-433d55b7-7a11-4495-9428-871411fd8cd9 req-e25cc354-9dce-4a39-9ca3-32b299701491 service nova] [instance: e32b1199-adf6-42ad-9a73-692aeb5e22a2] Received unexpected event network-vif-plugged-dac79aa2-eff8-454f-89ff-7452f58bf4aa for instance with vm_state deleted and task_state None.
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e4f6135c-879b-4a15-8798-b6d83e5823da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 09cc2918-c06d-4c20-bb2c-68f5e61382f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 7949bb9d-dd78-4017-b19d-9081ff68c700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5e15c942-2107-4572-8355-98004a4f43a6 tempest-VolumesNegativeTest-785450454 tempest-VolumesNegativeTest-785450454-project-member] Lock "e32b1199-adf6-42ad-9a73-692aeb5e22a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.385s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:12:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:12:38 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:12:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:12:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:12:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'flavor' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:04 user nova-compute[76161]: INFO nova.compute.manager [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Attaching volume a6ad57ba-4923-43e9-b584-371f6a390ed3 to /dev/vdb
Nov 14 18:13:04 user nova-compute[76161]: DEBUG os_brick.utils [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c1ff7a-3682-4c5f-8dce-3482ff02fa11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[353e01f0-9b6a-46c6-885a-7cd37b93b35a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dac739-0ef7-4c3a-8fcd-08e90e25090b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49b7f1d-3bab-45bf-ae20-8a343c6181ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:13:04 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:13:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[19caa801-81b3-438e-8e03-7c26eb86f8f5]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG os_brick.utils [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:13:04 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updating existing volume attachment record: 33c0ab9f-9750-4fbf-8f6e-f8372640fd13 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:13:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMuDmZAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:13:09 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:13:09 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:13:09 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf109318-f5de-4ba9-b309-a59d20faae9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:13:09 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8200eaea-9228-4cc4-8866-8551903dd82a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3] added
Nov 14 18:13:09 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b981dc7-93ef-4f25-864f-2dc210a95af2]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e54a1e-8f8f-4af5-be04-9ea8f6f519a3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMuDmZAW {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMuDmZAW" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b881f2c7-2175-4ecd-8b1b-8adde34851a1]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMuDmZAW'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabe54fb-d3a3-4b7d-86cf-f09924a582b7]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[af085738-440c-4569-9513-ab3e4467b506]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:13:09 user nova-compute[76161]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:13:09 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:13:09 user nova-compute[76161]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:13:09 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5debcdef-e064-401d-8d40-1d0389053a1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3, portal: 172.16.0.220,3260]
Nov 14 18:13:09 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3, portal: 172.16.0.220,3260] successful.
Nov 14 18:13:09 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b092b3b-9999-46fe-bd5c-b8a49bc3fb71]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5953bcc1-ab80-46db-b48b-d258cc5518a5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:13:09 user nova-compute[76161]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:13:09 user nova-compute[76161]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:13:09 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:13:09 user nova-compute[76161]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:13:09 user nova-compute[76161]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:13:09 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0cd85e-138a-477a-9779-c02fe01c3ea0]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:09 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMuDmZAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23433363338633235', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433363338633235', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'flavor' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:13:10 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:13:10 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:13:10 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:13:10 user nova-compute[76161]:   <serial>a6ad57ba-4923-43e9-b584-371f6a390ed3</serial>
Nov 14 18:13:10 user nova-compute[76161]: </disk>
Nov 14 18:13:10 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] No VIF found with MAC fa:16:3e:42:c6:04, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:13:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8d4557f1-6fac-4184-ac99-c9e7deb6c759 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.577s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:12 user nova-compute[76161]: INFO nova.compute.manager [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Rescuing
Nov 14 18:13:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:13:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquired lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:13:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:13:12 user nova-compute[76161]: DEBUG nova.network.neutron [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updating instance_info_cache with network_info: [{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:13:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Releasing lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:13:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-471f548a-6ca1-417d-b0b0-8af23b8d071c req-51b680e3-9e90-4c87-b477-18e2a991b271 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-unplugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-471f548a-6ca1-417d-b0b0-8af23b8d071c req-51b680e3-9e90-4c87-b477-18e2a991b271 service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-471f548a-6ca1-417d-b0b0-8af23b8d071c req-51b680e3-9e90-4c87-b477-18e2a991b271 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-471f548a-6ca1-417d-b0b0-8af23b8d071c req-51b680e3-9e90-4c87-b477-18e2a991b271 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-471f548a-6ca1-417d-b0b0-8af23b8d071c req-51b680e3-9e90-4c87-b477-18e2a991b271 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-unplugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:13:13 user nova-compute[76161]: WARNING nova.compute.manager [req-471f548a-6ca1-417d-b0b0-8af23b8d071c req-51b680e3-9e90-4c87-b477-18e2a991b271 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-unplugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state active and task_state rescuing.
Nov 14 18:13:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Instance destroyed successfully.
Nov 14 18:13:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Attempting a stable device rescue
Nov 14 18:13:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=76161) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Instance directory exists: not creating {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 18:13:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Creating image(s)
Nov 14 18:13:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "10e3d6be43f11361823f88a52e42a296b28bab6b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "10e3d6be43f11361823f88a52e42a296b28bab6b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b.part --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b.part --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:14 user nova-compute[76161]: DEBUG nova.virt.images [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] acff87ae-ce44-499e-826f-199c84cc359e was qcow2, converting to raw {{(pid=76161) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 18:13:14 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 18:13:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b.part /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b.converted {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-d0357b6d-e992-45fd-a9b5-fa8ec32f5a50 req-bc5c2b5d-3f92-417b-ad08-869cb84581e6 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0357b6d-e992-45fd-a9b5-fa8ec32f5a50 req-bc5c2b5d-3f92-417b-ad08-869cb84581e6 service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0357b6d-e992-45fd-a9b5-fa8ec32f5a50 req-bc5c2b5d-3f92-417b-ad08-869cb84581e6 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d0357b6d-e992-45fd-a9b5-fa8ec32f5a50 req-bc5c2b5d-3f92-417b-ad08-869cb84581e6 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-d0357b6d-e992-45fd-a9b5-fa8ec32f5a50 req-bc5c2b5d-3f92-417b-ad08-869cb84581e6 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:13:15 user nova-compute[76161]: WARNING nova.compute.manager [req-d0357b6d-e992-45fd-a9b5-fa8ec32f5a50 req-bc5c2b5d-3f92-417b-ad08-869cb84581e6 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state active and task_state rescuing.
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b.part /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b.converted" returned: 0 in 0.440s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b.converted --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "10e3d6be43f11361823f88a52e42a296b28bab6b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.796s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "10e3d6be43f11361823f88a52e42a296b28bab6b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "10e3d6be43f11361823f88a52e42a296b28bab6b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b,backing_fmt=raw /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-16ff117c-2853-41c9-bf5f-6337bec07e88 req-b3f7fd68-d75b-4ed2-9cdb-50e22134ee0a service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-changed-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-16ff117c-2853-41c9-bf5f-6337bec07e88 req-b3f7fd68-d75b-4ed2-9cdb-50e22134ee0a service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Refreshing instance network info cache due to event network-changed-5296e396-4864-4119-a35b-bc4eb12284c1. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-16ff117c-2853-41c9-bf5f-6337bec07e88 req-b3f7fd68-d75b-4ed2-9cdb-50e22134ee0a service nova] Acquiring lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-16ff117c-2853-41c9-bf5f-6337bec07e88 req-b3f7fd68-d75b-4ed2-9cdb-50e22134ee0a service nova] Acquired lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-16ff117c-2853-41c9-bf5f-6337bec07e88 req-b3f7fd68-d75b-4ed2-9cdb-50e22134ee0a service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Refreshing network info cache for port 5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b,backing_fmt=raw /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue" returned: 0 in 0.061s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "10e3d6be43f11361823f88a52e42a296b28bab6b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'migration_context' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.objects.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Object Instance<3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Start _get_guest_xml network_info=[{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "vif_mac": "fa:16:3e:42:c6:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'acff87ae-ce44-499e-826f-199c84cc359e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMuDmZAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6ad57ba-4923-43e9-b584-371f6a390ed3', 'serial': 'a6ad57ba-4923-43e9-b584-371f6a390ed3'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '33c0ab9f-9750-4fbf-8f6e-f8372640fd13', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'resources' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.objects.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Object Instance<3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'numa_topology' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.objects.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Object Instance<3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:13:15 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:13:15 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:13:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.objects.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Object Instance<3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMuDmZAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:13:15 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:13:15 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:13:15 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[11823d6a-0694-4729-bff6-6c67b0b77a2c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dMuDmZAW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 18:13:15 user nova-compute[76161]: node.name = iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3
Nov 14 18:13:15 user nova-compute[76161]: node.tpgt = -1
Nov 14 18:13:15 user nova-compute[76161]: node.startup = automatic
Nov 14 18:13:15 user nova-compute[76161]: node.leading_login = No
Nov 14 18:13:15 user nova-compute[76161]: iface.iscsi_ifacename = default
Nov 14 18:13:15 user nova-compute[76161]: iface.net_ifacename = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.ipaddress = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.prefix_len = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.hwaddress = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.transport_name = tcp
Nov 14 18:13:15 user nova-compute[76161]: iface.initiatorname = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.state = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.vlan_id = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.vlan_priority = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.vlan_state = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.iface_num = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.mtu = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.port = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.bootproto = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.subnet_mask = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.gateway = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.dhcp_alt_client_id = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.dhcp_dns = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.dhcp_learn_iqn = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.dhcp_vendor_id_state = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.dhcp_vendor_id = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.dhcp_slp_da = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.fragmentation = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.gratuitous_arp = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.incoming_forwarding = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.tos_state = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.tos = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.ttl = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.delayed_ack = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.tcp_nagle = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.tcp_wsf_state = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.tcp_wsf = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.tcp_timer_scale = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.tcp_timestamp = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.redirect = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.def_task_mgmt_timeout = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.header_digest = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.data_digest = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.immediate_data = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.initial_r2t = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.data_seq_inorder = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.data_pdu_inorder = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.erl = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.max_receive_data_len = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.first_burst_len = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.max_outstanding_r2t = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.max_burst_len = 0
Nov 14 18:13:15 user nova-compute[76161]: iface.chap_auth = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.bidi_chap = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.strict_login_compliance = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.discovery_auth = <empty>
Nov 14 18:13:15 user nova-compute[76161]: iface.discovery_logout = <empty>
Nov 14 18:13:15 user nova-compute[76161]: node.discovery_address = <empty>
Nov 14 18:13:15 user nova-compute[76161]: node.discovery_port = 0
Nov 14 18:13:15 user nova-compute[76161]: node.discovery_type = static
Nov 14 18:13:15 user nova-compute[76161]: node.session.initial_cmdsn = 0
Nov 14 18:13:15 user nova-compute[76161]: node.session.initial_login_retry_max = 8
Nov 14 18:13:15 user nova-compute[76161]: node.session.xmit_thread_priority = -20
Nov 14 18:13:15 user nova-compute[76161]: node.session.cmds_max = 128
Nov 14 18:13:15 user nova-compute[76161]: node.session.queue_depth = 32
Nov 14 18:13:15 user nova-compute[76161]: node.session.nr_sessions = 1
Nov 14 18:13:15 user nova-compute[76161]: node.session.auth.authmethod = CHAP
Nov 14 18:13:15 user nova-compute[76161]: node.session.auth.username = dMuDmZAW
Nov 14 18:13:15 user nova-compute[76161]: node.session.auth.password = ***
Nov 14 18:13:15 user nova-compute[76161]: node.session.auth.username_in = <empty>
Nov 14 18:13:15 user nova-compute[76161]: node.session.auth.password_in = <empty>
Nov 14 18:13:15 user nova-compute[76161]: node.session.auth.chap_algs = MD5
Nov 14 18:13:15 user nova-compute[76161]: node.session.timeo.replacement_timeout = 120
Nov 14 18:13:15 user nova-compute[76161]: node.session.err_timeo.abort_timeout = 15
Nov 14 18:13:15 user nova-compute[76161]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 18:13:15 user nova-compute[76161]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 18:13:15 user nova-compute[76161]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 18:13:15 user nova-compute[76161]: node.session.iscsi.FastAbort = Yes
Nov 14 18:13:15 user nova-compute[76161]: node.session.iscsi.InitialR2T = No
Nov 14 18:13:15 user nova-compute[76161]: node.session.iscsi.ImmediateData = Yes
Nov 14 18:13:15 user nova-compute[76161]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 18:13:15 user nova-compute[76161]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 18:13:15 user nova-compute[76161]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 18:13:15 user nova-compute[76161]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 18:13:15 user nova-compute[76161]: node.session.iscsi.MaxConnections = 1
Nov 14 18:13:15 user nova-compute[76161]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 18:13:15 user nova-compute[76161]: node.session.iscsi.ERL = 0
Nov 14 18:13:15 user nova-compute[76161]: node.session.scan = manual
Nov 14 18:13:15 user nova-compute[76161]: node.session.reopen_max = 0
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].address = 172.16.0.220
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].port = 3260
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].startup = manual
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].tcp.window_size = 524288
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].tcp.type_of_service = 0
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].timeo.logout_timeout = 15
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].timeo.login_timeout = 15
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].timeo.auth_timeout = 45
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].iscsi.DataDigest = None
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].iscsi.IFMarker = No
Nov 14 18:13:15 user nova-compute[76161]: node.conn[0].iscsi.OFMarker = No
Nov 14 18:13:15 user nova-compute[76161]: # END RECORD
Nov 14 18:13:15 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96b9cb0-88ea-4c19-b3b9-5b0a0ad0d062]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[62417de8-6857-47ed-90b9-02a0c044e8ca]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMuDmZAW {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMuDmZAW" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcfde5d-2c5f-4089-9aef-8979a7b38902]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMuDmZAW'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[201abe71-5a97-4b70-81d5-d85c7dff2152]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[299aa642-969d-4d66-af5a-79104cae3af9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:13:15 user nova-compute[76161]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:13:15 user nova-compute[76161]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:13:15 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:13:15 user nova-compute[76161]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:13:15 user nova-compute[76161]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:13:15 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] HCTL ('34', '0', '0', 0) found on session 54 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a73f1f-27e9-49b4-ace4-82c44d6df12f]: (4, ('0 0 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Searching for a device in session 54 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMuDmZAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '23433363338633235', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433363338633235', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-196351056',display_name='tempest-ServerStableDeviceRescueTest-server-196351056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-196351056',id=44,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77XaCIngo1th53padje9DsAhl9KOSKNZfZjKECok4W8bntCT4mMyM8EyF0mqq2RPfflzegwryBnKJf/5p1N/fK3vrUfhE2263FFBur2SdR/bJMZXl3/2cEbUtkm0HM/A==',key_name='tempest-keypair-1640878755',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd8a6f01a49a45df9ce7c8bb72fe09aa',ramdisk_id='',reservation_id='r-9p4i9zht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-888944149',owner_user_name='tempest-ServerStableDeviceRescueTest-888944149-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b58cf52433541ff9230d5d7a5944c40',uuid=3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "vif_mac": "fa:16:3e:42:c6:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Converting VIF {"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "vif_mac": "fa:16:3e:42:c6:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:c6:04,bridge_name='br-int',has_traffic_filtering=True,id=99e841f1-c43d-40dc-9376-8f64d20e4f15,network=Network(3e50900b-d50a-4af2-9e2a-b4be58b96dd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99e841f1-c4') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.objects.instance [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.objects.base [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Object Instance<3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:13:15 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:13:15 user nova-compute[76161]:   <uuid>3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98</uuid>
Nov 14 18:13:15 user nova-compute[76161]:   <name>instance-0000002c</name>
Nov 14 18:13:15 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:13:15 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:13:15 user nova-compute[76161]:   <metadata>
Nov 14 18:13:15 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:13:15 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:13:15 user nova-compute[76161]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-196351056</nova:name>
Nov 14 18:13:15 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:13:15</nova:creationTime>
Nov 14 18:13:15 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:13:15 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:13:15 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:13:15 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:13:15 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:13:15 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:13:15 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:13:15 user nova-compute[76161]:       <nova:owner>
Nov 14 18:13:15 user nova-compute[76161]:         <nova:user uuid="6b58cf52433541ff9230d5d7a5944c40">tempest-ServerStableDeviceRescueTest-888944149-project-member</nova:user>
Nov 14 18:13:15 user nova-compute[76161]:         <nova:project uuid="bd8a6f01a49a45df9ce7c8bb72fe09aa">tempest-ServerStableDeviceRescueTest-888944149</nova:project>
Nov 14 18:13:15 user nova-compute[76161]:       </nova:owner>
Nov 14 18:13:15 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:13:15 user nova-compute[76161]:       <nova:ports>
Nov 14 18:13:15 user nova-compute[76161]:         <nova:port uuid="99e841f1-c43d-40dc-9376-8f64d20e4f15">
Nov 14 18:13:15 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 18:13:15 user nova-compute[76161]:         </nova:port>
Nov 14 18:13:15 user nova-compute[76161]:       </nova:ports>
Nov 14 18:13:15 user nova-compute[76161]:     </nova:instance>
Nov 14 18:13:15 user nova-compute[76161]:   </metadata>
Nov 14 18:13:15 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:13:15 user nova-compute[76161]:     <system>
Nov 14 18:13:15 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:13:15 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:13:15 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:13:15 user nova-compute[76161]:       <entry name="serial">3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98</entry>
Nov 14 18:13:15 user nova-compute[76161]:       <entry name="uuid">3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98</entry>
Nov 14 18:13:15 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:13:15 user nova-compute[76161]:     </system>
Nov 14 18:13:15 user nova-compute[76161]:   </sysinfo>
Nov 14 18:13:15 user nova-compute[76161]:   <os>
Nov 14 18:13:15 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:13:15 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:13:15 user nova-compute[76161]:   </os>
Nov 14 18:13:15 user nova-compute[76161]:   <features>
Nov 14 18:13:15 user nova-compute[76161]:     <acpi/>
Nov 14 18:13:15 user nova-compute[76161]:     <apic/>
Nov 14 18:13:15 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:13:15 user nova-compute[76161]:   </features>
Nov 14 18:13:15 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:13:15 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:13:15 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:13:15 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:13:15 user nova-compute[76161]:   </clock>
Nov 14 18:13:15 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:13:15 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:13:15 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:13:15 user nova-compute[76161]:   </cpu>
Nov 14 18:13:15 user nova-compute[76161]:   <devices>
Nov 14 18:13:15 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:13:15 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:13:15 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk"/>
Nov 14 18:13:15 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:13:15 user nova-compute[76161]:     </disk>
Nov 14 18:13:15 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:13:15 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:13:15 user nova-compute[76161]:       <source dev="/dev/sdc"/>
Nov 14 18:13:15 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 18:13:15 user nova-compute[76161]:       <serial>a6ad57ba-4923-43e9-b584-371f6a390ed3</serial>
Nov 14 18:13:15 user nova-compute[76161]:     </disk>
Nov 14 18:13:15 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:13:15 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:13:15 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue"/>
Nov 14 18:13:15 user nova-compute[76161]:       <target dev="vdc" bus="virtio"/>
Nov 14 18:13:15 user nova-compute[76161]:       <boot order="1"/>
Nov 14 18:13:15 user nova-compute[76161]:     </disk>
Nov 14 18:13:15 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:13:15 user nova-compute[76161]:       <mac address="fa:16:3e:42:c6:04"/>
Nov 14 18:13:15 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:13:15 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:13:15 user nova-compute[76161]:       <target dev="tap99e841f1-c4"/>
Nov 14 18:13:15 user nova-compute[76161]:     </interface>
Nov 14 18:13:15 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:13:15 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/console.log" append="off"/>
Nov 14 18:13:15 user nova-compute[76161]:     </serial>
Nov 14 18:13:15 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:13:15 user nova-compute[76161]:     <video>
Nov 14 18:13:15 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:13:15 user nova-compute[76161]:     </video>
Nov 14 18:13:15 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:13:15 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:13:15 user nova-compute[76161]:     </rng>
Nov 14 18:13:15 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:13:15 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:13:15 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:13:15 user nova-compute[76161]:     </memballoon>
Nov 14 18:13:15 user nova-compute[76161]:   </devices>
Nov 14 18:13:15 user nova-compute[76161]: </domain>
Nov 14 18:13:15 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:13:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Instance destroyed successfully.
Nov 14 18:13:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-16ff117c-2853-41c9-bf5f-6337bec07e88 req-b3f7fd68-d75b-4ed2-9cdb-50e22134ee0a service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updated VIF entry in instance network info cache for port 5296e396-4864-4119-a35b-bc4eb12284c1. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-16ff117c-2853-41c9-bf5f-6337bec07e88 req-b3f7fd68-d75b-4ed2-9cdb-50e22134ee0a service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updating instance_info_cache with network_info: [{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:13:16 user nova-compute[76161]: INFO nova.compute.manager [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Detaching volume 0b7d20d7-67ad-42ab-a871-c570f1d91e6b
Nov 14 18:13:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-16ff117c-2853-41c9-bf5f-6337bec07e88 req-b3f7fd68-d75b-4ed2-9cdb-50e22134ee0a service nova] Releasing lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] No VIF found with MAC fa:16:3e:42:c6:04, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:13:16 user nova-compute[76161]: INFO nova.virt.block_device [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Attempting to driver detach volume 0b7d20d7-67ad-42ab-a871-c570f1d91e6b from mountpoint /dev/vdb
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Attempting to detach device vdb from instance e4f6135c-879b-4a15-8798-b6d83e5823da from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:13:16 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:13:16 user nova-compute[76161]:   <source dev="/dev/sdd"/>
Nov 14 18:13:16 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:13:16 user nova-compute[76161]:   <serial>0b7d20d7-67ad-42ab-a871-c570f1d91e6b</serial>
Nov 14 18:13:16 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:13:16 user nova-compute[76161]: </disk>
Nov 14 18:13:16 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:13:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Successfully detached device vdb from instance e4f6135c-879b-4a15-8798-b6d83e5823da from the persistent domain config.
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4f6135c-879b-4a15-8798-b6d83e5823da from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:13:16 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:13:16 user nova-compute[76161]:   <source dev="/dev/sdd"/>
Nov 14 18:13:16 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:13:16 user nova-compute[76161]:   <serial>0b7d20d7-67ad-42ab-a871-c570f1d91e6b</serial>
Nov 14 18:13:16 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:13:16 user nova-compute[76161]: </disk>
Nov 14 18:13:16 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:13:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-ba466473-34d7-4a43-b89c-7c62b57f57f9 req-6da47ec3-ed9a-4903-b1bd-2fb06ae1e7cf service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-changed-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-ba466473-34d7-4a43-b89c-7c62b57f57f9 req-6da47ec3-ed9a-4903-b1bd-2fb06ae1e7cf service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Refreshing instance network info cache due to event network-changed-5296e396-4864-4119-a35b-bc4eb12284c1. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ba466473-34d7-4a43-b89c-7c62b57f57f9 req-6da47ec3-ed9a-4903-b1bd-2fb06ae1e7cf service nova] Acquiring lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ba466473-34d7-4a43-b89c-7c62b57f57f9 req-6da47ec3-ed9a-4903-b1bd-2fb06ae1e7cf service nova] Acquired lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-ba466473-34d7-4a43-b89c-7c62b57f57f9 req-6da47ec3-ed9a-4903-b1bd-2fb06ae1e7cf service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Refreshing network info cache for port 5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-cf5dc599-a13e-4253-ace2-cd6f1db21701 req-59e6132a-f1c9-4dec-bc05-b1a3962c8a83 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cf5dc599-a13e-4253-ace2-cd6f1db21701 req-59e6132a-f1c9-4dec-bc05-b1a3962c8a83 service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cf5dc599-a13e-4253-ace2-cd6f1db21701 req-59e6132a-f1c9-4dec-bc05-b1a3962c8a83 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cf5dc599-a13e-4253-ace2-cd6f1db21701 req-59e6132a-f1c9-4dec-bc05-b1a3962c8a83 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-cf5dc599-a13e-4253-ace2-cd6f1db21701 req-59e6132a-f1c9-4dec-bc05-b1a3962c8a83 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:13:17 user nova-compute[76161]: WARNING nova.compute.manager [req-cf5dc599-a13e-4253-ace2-cd6f1db21701 req-59e6132a-f1c9-4dec-bc05-b1a3962c8a83 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state active and task_state rescuing.
Nov 14 18:13:18 user nova-compute[76161]: DEBUG nova.network.neutron [req-ba466473-34d7-4a43-b89c-7c62b57f57f9 req-6da47ec3-ed9a-4903-b1bd-2fb06ae1e7cf service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updated VIF entry in instance network info cache for port 5296e396-4864-4119-a35b-bc4eb12284c1. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:13:18 user nova-compute[76161]: DEBUG nova.network.neutron [req-ba466473-34d7-4a43-b89c-7c62b57f57f9 req-6da47ec3-ed9a-4903-b1bd-2fb06ae1e7cf service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updating instance_info_cache with network_info: [{"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:13:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ba466473-34d7-4a43-b89c-7c62b57f57f9 req-6da47ec3-ed9a-4903-b1bd-2fb06ae1e7cf service nova] Releasing lock "refresh_cache-e4f6135c-879b-4a15-8798-b6d83e5823da" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:13:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-f9961658-476c-4a8b-a8b1-e6f0bf65b3ea req-e6e25524-e8b6-4d3e-a1b3-875a7c4542b9 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:13:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f9961658-476c-4a8b-a8b1-e6f0bf65b3ea req-e6e25524-e8b6-4d3e-a1b3-875a7c4542b9 service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f9961658-476c-4a8b-a8b1-e6f0bf65b3ea req-e6e25524-e8b6-4d3e-a1b3-875a7c4542b9 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-f9961658-476c-4a8b-a8b1-e6f0bf65b3ea req-e6e25524-e8b6-4d3e-a1b3-875a7c4542b9 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-f9961658-476c-4a8b-a8b1-e6f0bf65b3ea req-e6e25524-e8b6-4d3e-a1b3-875a7c4542b9 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:13:19 user nova-compute[76161]: WARNING nova.compute.manager [req-f9961658-476c-4a8b-a8b1-e6f0bf65b3ea req-e6e25524-e8b6-4d3e-a1b3-875a7c4542b9 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state active and task_state rescuing.
Nov 14 18:13:19 user nova-compute[76161]: DEBUG nova.compute.manager [None req-bd8d50bd-1bfc-4f2d-94e7-c392218cda74 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:13:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:27 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:13:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:13:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:13:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:13:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:13:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updating instance_info_cache with network_info: [{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:13:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:13:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:13:27 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:13:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:13:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:13:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:13:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:13:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:13:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:13:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:13:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:31 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:13:31 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-800f129d-9a5b-47aa-b605-6a09be091f7f req-96627dd4-d2bf-4ac2-b72e-a392a3853923 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received event network-changed-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-800f129d-9a5b-47aa-b605-6a09be091f7f req-96627dd4-d2bf-4ac2-b72e-a392a3853923 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Refreshing instance network info cache due to event network-changed-48a27c1a-149e-4bb2-9a10-11ee5274e349. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-800f129d-9a5b-47aa-b605-6a09be091f7f req-96627dd4-d2bf-4ac2-b72e-a392a3853923 service nova] Acquiring lock "refresh_cache-09cc2918-c06d-4c20-bb2c-68f5e61382f1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-800f129d-9a5b-47aa-b605-6a09be091f7f req-96627dd4-d2bf-4ac2-b72e-a392a3853923 service nova] Acquired lock "refresh_cache-09cc2918-c06d-4c20-bb2c-68f5e61382f1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG nova.network.neutron [req-800f129d-9a5b-47aa-b605-6a09be091f7f req-96627dd4-d2bf-4ac2-b72e-a392a3853923 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Refreshing network info cache for port 48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:33 user nova-compute[76161]: INFO nova.compute.manager [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Terminating instance
Nov 14 18:13:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG nova.network.neutron [req-800f129d-9a5b-47aa-b605-6a09be091f7f req-96627dd4-d2bf-4ac2-b72e-a392a3853923 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Updated VIF entry in instance network info cache for port 48a27c1a-149e-4bb2-9a10-11ee5274e349. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG nova.network.neutron [req-800f129d-9a5b-47aa-b605-6a09be091f7f req-96627dd4-d2bf-4ac2-b72e-a392a3853923 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Updating instance_info_cache with network_info: [{"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-800f129d-9a5b-47aa-b605-6a09be091f7f req-96627dd4-d2bf-4ac2-b72e-a392a3853923 service nova] Releasing lock "refresh_cache-09cc2918-c06d-4c20-bb2c-68f5e61382f1" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-95253589-a79a-4204-ae3c-498b1fd1b305 req-9f031893-0601-4b63-96ec-0893af8df65d service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received event network-vif-unplugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-95253589-a79a-4204-ae3c-498b1fd1b305 req-9f031893-0601-4b63-96ec-0893af8df65d service nova] Acquiring lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-95253589-a79a-4204-ae3c-498b1fd1b305 req-9f031893-0601-4b63-96ec-0893af8df65d service nova] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-95253589-a79a-4204-ae3c-498b1fd1b305 req-9f031893-0601-4b63-96ec-0893af8df65d service nova] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-95253589-a79a-4204-ae3c-498b1fd1b305 req-9f031893-0601-4b63-96ec-0893af8df65d service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] No waiting events found dispatching network-vif-unplugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:13:33 user nova-compute[76161]: DEBUG nova.compute.manager [req-95253589-a79a-4204-ae3c-498b1fd1b305 req-9f031893-0601-4b63-96ec-0893af8df65d service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received event network-vif-unplugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:13:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Instance destroyed successfully.
Nov 14 18:13:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'resources' on Instance uuid 09cc2918-c06d-4c20-bb2c-68f5e61382f1 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-630729042',display_name='tempest-TestVolumeBootPattern-server-630729042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-630729042',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHVYDN2Xftf5V1grXUvkOAuZ4lRy2Yu8x71x7XZMVIMR4I5qKGZtkFKrVxApclfxwZHmCeNjcLNUIFGzVbzrwECoYdV2hlra8hiYCIDqSv04geiOynO7IsegUM2gQdCg==',key_name='tempest-TestVolumeBootPattern-706510423',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:11:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-fkgyd2mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:11:52Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=09cc2918-c06d-4c20-bb2c-68f5e61382f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "address": "fa:16:3e:d3:c6:14", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a27c1a-14", "ovs_interfaceid": "48a27c1a-149e-4bb2-9a10-11ee5274e349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c6:14,bridge_name='br-int',has_traffic_filtering=True,id=48a27c1a-149e-4bb2-9a10-11ee5274e349,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a27c1a-14') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_vif [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c6:14,bridge_name='br-int',has_traffic_filtering=True,id=48a27c1a-149e-4bb2-9a10-11ee5274e349,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a27c1a-14') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48a27c1a-14, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b162e13-055d-471e-b748-da96010ae794) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:34 user nova-compute[76161]: INFO os_vif [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c6:14,bridge_name='br-int',has_traffic_filtering=True,id=48a27c1a-149e-4bb2-9a10-11ee5274e349,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a27c1a-14')
Nov 14 18:13:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnCHeIof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:13:34 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[570dce10-1de8-4464-9efe-d4a8d543d99a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:13:34 user nova-compute[76161]: No targets found.
Nov 14 18:13:34 user nova-compute[76161]: iSNS:
Nov 14 18:13:34 user nova-compute[76161]: No targets found.
Nov 14 18:13:34 user nova-compute[76161]: STATIC:
Nov 14 18:13:34 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b
Nov 14 18:13:34 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:13:34 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:13:34 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3
Nov 14 18:13:34 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:13:34 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:13:34 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e
Nov 14 18:13:34 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:13:34 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:13:34 user nova-compute[76161]: FIRMWARE:
Nov 14 18:13:34 user nova-compute[76161]: No targets found.
Nov 14 18:13:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:13:34 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:13:34 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d9977c-c332-4bc1-8be2-bd2bb9c09f3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1972b2cf-d3c4-4d72-acf1-25599ac6aafa]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:13:34 user nova-compute[76161]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:13:34 user nova-compute[76161]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:13:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:13:34 user nova-compute[76161]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:13:34 user nova-compute[76161]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:13:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f012fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0bdca3-3f10-4663-b642-2caebd5c1e9d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d421092a-fdd5-462b-9c44-c9a00d4e169b]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83fe463-3053-4975-a189-34d48c528c5f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb201d38-da3e-476c-9274-5379410091ad]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1a204e9d-22e90ddb7e0707a6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1a204e9d', '/dev/disk/by-id/scsi-23232653930646462') {{(pid=86560) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5167dad-08a9-4338-9f73-408cc38ac7d3]: (4, None) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfc18ab-a601-4bca-ac22-a60580c3fc3c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8677d518-9fa4-4eb7-bc20-666685686d77]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260]
Nov 14 18:13:34 user nova-compute[76161]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260] successful.
Nov 14 18:13:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98fca28-f9db-4024-94be-02af06f4a235]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== disconnect_volume: return (350ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:13:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Deleting instance files /opt/stack/data/nova/instances/09cc2918-c06d-4c20-bb2c-68f5e61382f1_del
Nov 14 18:13:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Deletion of /opt/stack/data/nova/instances/09cc2918-c06d-4c20-bb2c-68f5e61382f1_del complete
Nov 14 18:13:34 user nova-compute[76161]: INFO nova.compute.manager [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 14 18:13:34 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:13:34 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:13:35 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:13:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:35 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:13:35 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Took 0.87 seconds to deallocate network for instance.
Nov 14 18:13:35 user nova-compute[76161]: DEBUG nova.compute.manager [req-eaacc742-cac3-4d92-8a5c-e21d2aae05f1 req-546def3c-127e-4160-a289-851e89943fc8 service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received event network-vif-deleted-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG nova.compute.manager [req-d79eb4cd-4a0b-4fc5-a304-c6f6be0c7d10 req-885beade-dc06-4cab-9cd6-a9e3c8eaeb9e service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received event network-vif-plugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d79eb4cd-4a0b-4fc5-a304-c6f6be0c7d10 req-885beade-dc06-4cab-9cd6-a9e3c8eaeb9e service nova] Acquiring lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d79eb4cd-4a0b-4fc5-a304-c6f6be0c7d10 req-885beade-dc06-4cab-9cd6-a9e3c8eaeb9e service nova] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d79eb4cd-4a0b-4fc5-a304-c6f6be0c7d10 req-885beade-dc06-4cab-9cd6-a9e3c8eaeb9e service nova] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG nova.compute.manager [req-d79eb4cd-4a0b-4fc5-a304-c6f6be0c7d10 req-885beade-dc06-4cab-9cd6-a9e3c8eaeb9e service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] No waiting events found dispatching network-vif-plugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:13:36 user nova-compute[76161]: WARNING nova.compute.manager [req-d79eb4cd-4a0b-4fc5-a304-c6f6be0c7d10 req-885beade-dc06-4cab-9cd6-a9e3c8eaeb9e service nova] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Received unexpected event network-vif-plugged-48a27c1a-149e-4bb2-9a10-11ee5274e349 for instance with vm_state active and task_state deleting.
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: INFO nova.compute.manager [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: 09cc2918-c06d-4c20-bb2c-68f5e61382f1] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e4f6135c-879b-4a15-8798-b6d83e5823da is timed out.
Nov 14 18:13:36 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Successfully detached device vdb from instance e4f6135c-879b-4a15-8798-b6d83e5823da from the live domain config.
Nov 14 18:13:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGWfuLXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:13:36 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6baf110-0365-4875-a780-c69e6a7a6757]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:13:36 user nova-compute[76161]: No targets found.
Nov 14 18:13:36 user nova-compute[76161]: iSNS:
Nov 14 18:13:36 user nova-compute[76161]: No targets found.
Nov 14 18:13:36 user nova-compute[76161]: STATIC:
Nov 14 18:13:36 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b
Nov 14 18:13:36 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:13:36 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:13:36 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3
Nov 14 18:13:36 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:13:36 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:13:36 user nova-compute[76161]: FIRMWARE:
Nov 14 18:13:36 user nova-compute[76161]: No targets found.
Nov 14 18:13:36 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:13:36 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:13:36 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29792b0-74ff-4c5e-bc81-63004425795b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5506a83-f2b9-4f1e-b067-4ea4fb6ac180]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:13:36 user nova-compute[76161]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:13:36 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b (non-flash)
Nov 14 18:13:36 user nova-compute[76161]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:13:36 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb501893d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b'): ({'sdd'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Removing single pathed devices sdd {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76fbcbc-b734-4a32-9ae0-1ce8066fba60]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Deleted allocations for instance 09cc2918-c06d-4c20-bb2c-68f5e61382f1
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dff2f0-c9b4-4ce5-9063-63c51ba432db]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Flushing IO for device /dev/sdd {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[808beff5-46c4-48ce-93e3-011a1dc98172]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bce2932-9065-4a8a-bfca-5fc3d5792227]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] SCSI volumes sdd have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-35eb1868-42a1-4ab2-a8f1-37a097f49854 tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "09cc2918-c06d-4c20-bb2c-68f5e61382f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.364s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7793f9-8840-4eea-b100-bfbd10b5b5f1]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf6c40-7650-4ddb-b815-574d06c5033e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b, portal: 172.16.0.220,3260]
Nov 14 18:13:37 user nova-compute[76161]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b, portal: 172.16.0.220,3260] successful.
Nov 14 18:13:37 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b7d20d7-67ad-42ab-a871-c570f1d91e6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c362c92-6435-4e50-a92b-fcee052684f4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] <== disconnect_volume: return (388ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'flavor' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8798ef7e-b2ca-4517-b3fe-f87e7427da8e tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.831s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:13:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:39 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:13:39 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8331MB free_disk=24.956085205078125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance e4f6135c-879b-4a15-8798-b6d83e5823da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 7949bb9d-dd78-4017-b19d-9081ff68c700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:13:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:13:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:13:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:13:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:13:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:13:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:13:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "7949bb9d-dd78-4017-b19d-9081ff68c700" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:06 user nova-compute[76161]: INFO nova.compute.manager [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Terminating instance
Nov 14 18:14:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:06 user nova-compute[76161]: INFO nova.compute.manager [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Terminating instance
Nov 14 18:14:06 user nova-compute[76161]: DEBUG nova.compute.manager [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-e12f35e0-7476-4497-beae-9cc0945c425d req-9c4f17d0-a788-4e4f-ad2d-b7f3c97fc4a8 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Received event network-vif-unplugged-ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e12f35e0-7476-4497-beae-9cc0945c425d req-9c4f17d0-a788-4e4f-ad2d-b7f3c97fc4a8 service nova] Acquiring lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e12f35e0-7476-4497-beae-9cc0945c425d req-9c4f17d0-a788-4e4f-ad2d-b7f3c97fc4a8 service nova] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e12f35e0-7476-4497-beae-9cc0945c425d req-9c4f17d0-a788-4e4f-ad2d-b7f3c97fc4a8 service nova] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-e12f35e0-7476-4497-beae-9cc0945c425d req-9c4f17d0-a788-4e4f-ad2d-b7f3c97fc4a8 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] No waiting events found dispatching network-vif-unplugged-ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-e12f35e0-7476-4497-beae-9cc0945c425d req-9c4f17d0-a788-4e4f-ad2d-b7f3c97fc4a8 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Received event network-vif-unplugged-ae359a31-0dfc-4329-b089-9ce0c04192fa for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-80d227c5-2a78-4b3c-93b9-0f2810d30c22 req-6ea0fa93-bd87-43b8-9d05-987d29d979cc service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-80d227c5-2a78-4b3c-93b9-0f2810d30c22 req-6ea0fa93-bd87-43b8-9d05-987d29d979cc service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-80d227c5-2a78-4b3c-93b9-0f2810d30c22 req-6ea0fa93-bd87-43b8-9d05-987d29d979cc service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-80d227c5-2a78-4b3c-93b9-0f2810d30c22 req-6ea0fa93-bd87-43b8-9d05-987d29d979cc service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-80d227c5-2a78-4b3c-93b9-0f2810d30c22 req-6ea0fa93-bd87-43b8-9d05-987d29d979cc service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-80d227c5-2a78-4b3c-93b9-0f2810d30c22 req-6ea0fa93-bd87-43b8-9d05-987d29d979cc service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:14:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Instance destroyed successfully.
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lazy-loading 'resources' on Instance uuid 7949bb9d-dd78-4017-b19d-9081ff68c700 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:14:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Instance destroyed successfully.
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'resources' on Instance uuid e4f6135c-879b-4a15-8798-b6d83e5823da {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:12:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-161431581',display_name='tempest-VolumesActionsTest-instance-161431581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-161431581',id=47,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64059d5429f2468f8dbcc256a47a5957',ramdisk_id='',reservation_id='r-em9qgrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1577186745',owner_user_name='tempest-VolumesActionsTest-1577186745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:12:22Z,user_data=None,user_id='0f74d7304b3e40c389c28e84361ce1a0',uuid=7949bb9d-dd78-4017-b19d-9081ff68c700,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "address": "fa:16:3e:ad:53:75", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae359a31-0d", "ovs_interfaceid": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converting VIF {"id": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "address": "fa:16:3e:ad:53:75", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae359a31-0d", "ovs_interfaceid": "ae359a31-0dfc-4329-b089-9ce0c04192fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:53:75,bridge_name='br-int',has_traffic_filtering=True,id=ae359a31-0dfc-4329-b089-9ce0c04192fa,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae359a31-0d') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG os_vif [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:53:75,bridge_name='br-int',has_traffic_filtering=True,id=ae359a31-0dfc-4329-b089-9ce0c04192fa,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae359a31-0d') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1076990849',display_name='tempest-ServerRescueNegativeTestJSON-server-1076990849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1076990849',id=41,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBeZoRV3kMXn/GA46eMNNcJ0tRZceNHh7TAIS5rF1neUcM4S6sNuRCXF0QtpQeXfc7hMCS+WkohSV8NcLF0hT2hw1cucJ9T0krp596vdpHjZgIxTbNUVRRJKYsl61TLWA==',key_name='tempest-keypair-719486534',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:09:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-puohjd9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:11:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=e4f6135c-879b-4a15-8798-b6d83e5823da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "5296e396-4864-4119-a35b-bc4eb12284c1", "address": "fa:16:3e:38:8a:b9", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5296e396-48", "ovs_interfaceid": "5296e396-4864-4119-a35b-bc4eb12284c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:8a:b9,bridge_name='br-int',has_traffic_filtering=True,id=5296e396-4864-4119-a35b-bc4eb12284c1,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296e396-48') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG os_vif [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:8a:b9,bridge_name='br-int',has_traffic_filtering=True,id=5296e396-4864-4119-a35b-bc4eb12284c1,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296e396-48') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae359a31-0d, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5296e396-48, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33f26c9e-3cbb-4628-90c4-f99ad56dc0e7) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01964561-9eb5-41a7-83b4-11038bb5fcb0) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:07 user nova-compute[76161]: INFO os_vif [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:53:75,bridge_name='br-int',has_traffic_filtering=True,id=ae359a31-0dfc-4329-b089-9ce0c04192fa,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae359a31-0d')
Nov 14 18:14:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Deleting instance files /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700_del
Nov 14 18:14:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Deletion of /opt/stack/data/nova/instances/7949bb9d-dd78-4017-b19d-9081ff68c700_del complete
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:14:07 user nova-compute[76161]: INFO os_vif [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:8a:b9,bridge_name='br-int',has_traffic_filtering=True,id=5296e396-4864-4119-a35b-bc4eb12284c1,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5296e396-48')
Nov 14 18:14:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Deleting instance files /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da_del
Nov 14 18:14:07 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Deletion of /opt/stack/data/nova/instances/e4f6135c-879b-4a15-8798-b6d83e5823da_del complete
Nov 14 18:14:07 user nova-compute[76161]: INFO nova.compute.manager [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 14 18:14:07 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:14:07 user nova-compute[76161]: INFO nova.compute.manager [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 14 18:14:07 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:14:08 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Took 0.59 seconds to deallocate network for instance.
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-0c694e06-42fc-48bd-aaaf-bb40e94a61dd req-1152443f-e8ea-4b7c-a23c-40eb6cfed289 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Received event network-vif-deleted-ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:08 user nova-compute[76161]: INFO nova.compute.manager [req-0c694e06-42fc-48bd-aaaf-bb40e94a61dd req-1152443f-e8ea-4b7c-a23c-40eb6cfed289 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Neutron deleted interface ae359a31-0dfc-4329-b089-9ce0c04192fa; detaching it from the instance and deleting it from the info cache
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.network.neutron [req-0c694e06-42fc-48bd-aaaf-bb40e94a61dd req-1152443f-e8ea-4b7c-a23c-40eb6cfed289 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-0c694e06-42fc-48bd-aaaf-bb40e94a61dd req-1152443f-e8ea-4b7c-a23c-40eb6cfed289 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Detach interface failed, port_id=ae359a31-0dfc-4329-b089-9ce0c04192fa, reason: Instance 7949bb9d-dd78-4017-b19d-9081ff68c700 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:08 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Deleted allocations for instance 7949bb9d-dd78-4017-b19d-9081ff68c700
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-42dc8816-6f6c-4ecd-85dd-395b6413f6a4 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.286s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-1fc36d36-6f09-470b-8254-d7d078c38a83 req-61dcef27-8045-4245-8058-329c5ee0e1f4 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Received event network-vif-plugged-ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1fc36d36-6f09-470b-8254-d7d078c38a83 req-61dcef27-8045-4245-8058-329c5ee0e1f4 service nova] Acquiring lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1fc36d36-6f09-470b-8254-d7d078c38a83 req-61dcef27-8045-4245-8058-329c5ee0e1f4 service nova] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1fc36d36-6f09-470b-8254-d7d078c38a83 req-61dcef27-8045-4245-8058-329c5ee0e1f4 service nova] Lock "7949bb9d-dd78-4017-b19d-9081ff68c700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-1fc36d36-6f09-470b-8254-d7d078c38a83 req-61dcef27-8045-4245-8058-329c5ee0e1f4 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] No waiting events found dispatching network-vif-plugged-ae359a31-0dfc-4329-b089-9ce0c04192fa {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:08 user nova-compute[76161]: WARNING nova.compute.manager [req-1fc36d36-6f09-470b-8254-d7d078c38a83 req-61dcef27-8045-4245-8058-329c5ee0e1f4 service nova] [instance: 7949bb9d-dd78-4017-b19d-9081ff68c700] Received unexpected event network-vif-plugged-ae359a31-0dfc-4329-b089-9ce0c04192fa for instance with vm_state deleted and task_state None.
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:08 user nova-compute[76161]: WARNING nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state active and task_state deleting.
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:08 user nova-compute[76161]: WARNING nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state active and task_state deleting.
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:08 user nova-compute[76161]: WARNING nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state active and task_state deleting.
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-unplugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Acquiring lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] No waiting events found dispatching network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:08 user nova-compute[76161]: WARNING nova.compute.manager [req-bfad7324-29d0-4f1f-bde1-2f2a0f5394ed req-b6d12d14-819f-4623-b1d5-710904b6896b service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received unexpected event network-vif-plugged-5296e396-4864-4119-a35b-bc4eb12284c1 for instance with vm_state active and task_state deleting.
Nov 14 18:14:09 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:14:09 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Took 1.47 seconds to deallocate network for instance.
Nov 14 18:14:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:09 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:14:09 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:14:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:09 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Deleted allocations for instance e4f6135c-879b-4a15-8798-b6d83e5823da
Nov 14 18:14:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-87c26341-90df-4ece-8679-af70d8b3c581 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "e4f6135c-879b-4a15-8798-b6d83e5823da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.878s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-bfe68ffd-a374-4d6b-9a7a-cf75f84f2ca6 req-92dae66c-aaf6-4182-a17c-3d40cedafddc service nova] [instance: e4f6135c-879b-4a15-8798-b6d83e5823da] Received event network-vif-deleted-5296e396-4864-4119-a35b-bc4eb12284c1 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:14:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:25 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:14:25 user nova-compute[76161]: INFO nova.compute.claims [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Claim successful on node user
Nov 14 18:14:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:25 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:14:25 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:14:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:25 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:14:26 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:14:26 user nova-compute[76161]: INFO nova.virt.block_device [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Booting with volume 78b45bd9-d89b-4ed9-a248-f2bebec9e71e at /dev/vda
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.policy [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd22a86988e6043d2ab950e0d6e557ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81682e21827c4572b1659004cc22215a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG os_brick.utils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af8db51-cbdb-4df8-8177-5302e7f6efe3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[335cabb2-d00e-4e8c-ba39-8356766a611a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47c1c96-6761-4cc4-942d-c158bbf7537b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d70ff5-4626-4bba-bd0b-6caa0b0dd83a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:14:26 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddee675a-0d62-4b04-b9d7-318b17d6b32c]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG os_brick.utils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Updating existing volume attachment record: a4cd2f4b-65c0-4d34-a2fa-50f75a7ab690 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:14:26 user nova-compute[76161]: INFO nova.compute.claims [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Claim successful on node user
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Successfully created port: 0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.network.neutron [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:14:26 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:14:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.policy [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcb6dc8c680145809756f79ccc78ead8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e313849c0b452e9dd6f5afd4006e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:14:27 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Creating image(s)
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "/opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "/opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "/opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "64ebdec4384415961f35d07d850268a05aeb2671" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "64ebdec4384415961f35d07d850268a05aeb2671" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671.part --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Successfully updated port: 0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-485206f7-8947-4f84-9937-c28cb38bf0f2 req-eb7ecff5-3b6c-4cfa-8700-1e344f850b79 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received event network-changed-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-485206f7-8947-4f84-9937-c28cb38bf0f2 req-eb7ecff5-3b6c-4cfa-8700-1e344f850b79 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Refreshing instance network info cache due to event network-changed-0c711a49-404c-480b-87e1-dc2560ad2844. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-485206f7-8947-4f84-9937-c28cb38bf0f2 req-eb7ecff5-3b6c-4cfa-8700-1e344f850b79 service nova] Acquiring lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-485206f7-8947-4f84-9937-c28cb38bf0f2 req-eb7ecff5-3b6c-4cfa-8700-1e344f850b79 service nova] Acquired lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-485206f7-8947-4f84-9937-c28cb38bf0f2 req-eb7ecff5-3b6c-4cfa-8700-1e344f850b79 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Refreshing network info cache for port 0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671.part --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.virt.images [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] 7640a2d0-54ea-4669-a8db-a1f48011dda6 was qcow2, converting to raw {{(pid=76161) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671.part /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671.converted {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Successfully created port: 85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-485206f7-8947-4f84-9937-c28cb38bf0f2 req-eb7ecff5-3b6c-4cfa-8700-1e344f850b79 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671.part /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671.converted" returned: 0 in 0.156s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671.converted --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.network.neutron [req-485206f7-8947-4f84-9937-c28cb38bf0f2 req-eb7ecff5-3b6c-4cfa-8700-1e344f850b79 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-485206f7-8947-4f84-9937-c28cb38bf0f2 req-eb7ecff5-3b6c-4cfa-8700-1e344f850b79 service nova] Releasing lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquired lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "64ebdec4384415961f35d07d850268a05aeb2671" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.057s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671 --force-share --output=json" returned: 0 in 0.184s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "64ebdec4384415961f35d07d850268a05aeb2671" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "64ebdec4384415961f35d07d850268a05aeb2671" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671 --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671,backing_fmt=raw /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Updating instance_info_cache with network_info: [{"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671,backing_fmt=raw /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk 1073741824" returned: 0 in 0.069s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "64ebdec4384415961f35d07d850268a05aeb2671" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Releasing lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Instance network_info: |[{"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Successfully updated port: 85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquired lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-c89b720c-b384-49da-ba0a-45d7addc46ba req-d5bdae3f-5175-4e15-88f8-fddf87450988 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-changed-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-c89b720c-b384-49da-ba0a-45d7addc46ba req-d5bdae3f-5175-4e15-88f8-fddf87450988 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Refreshing instance network info cache due to event network-changed-85a65a97-cac5-41c2-9943-4cbc64cb9c21. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c89b720c-b384-49da-ba0a-45d7addc46ba req-d5bdae3f-5175-4e15-88f8-fddf87450988 service nova] Acquiring lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671 --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Cannot resize image /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Ensure instance console log exists: /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.network.neutron [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updating instance_info_cache with network_info: [{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Releasing lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.compute.manager [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Instance network_info: |[{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c89b720c-b384-49da-ba0a-45d7addc46ba req-d5bdae3f-5175-4e15-88f8-fddf87450988 service nova] Acquired lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.network.neutron [req-c89b720c-b384-49da-ba0a-45d7addc46ba req-d5bdae3f-5175-4e15-88f8-fddf87450988 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Refreshing network info cache for port 85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Start _get_guest_xml network_info=[{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T18:14:23Z,direct_url=<?>,disk_format='qcow2',id=7640a2d0-54ea-4669-a8db-a1f48011dda6,min_disk=0,min_ram=0,name='tempest-scenario-img--220065034',owner='83e313849c0b452e9dd6f5afd4006e31',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T18:14:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '7640a2d0-54ea-4669-a8db-a1f48011dda6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:14:29 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:14:29 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T18:14:23Z,direct_url=<?>,disk_format='qcow2',id=7640a2d0-54ea-4669-a8db-a1f48011dda6,min_disk=0,min_ram=0,name='tempest-scenario-img--220065034',owner='83e313849c0b452e9dd6f5afd4006e31',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T18:14:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1070282106',display_name='tempest-TestMinimumBasicScenario-server-1070282106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1070282106',id=49,image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjEeSYdg8v8pt4SmYmzNQO5ZL1McegI+xu8cN/VHJTsi7Bn6WW6HjSG4OAYHkziGNE2clc6cJDmcYgvtcc5fazdsZIGzLsPjKOgooFUT+gajlYmF81p6ViKBNYNiRyEJA==',key_name='tempest-TestMinimumBasicScenario-1264911207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e313849c0b452e9dd6f5afd4006e31',ramdisk_id='',reservation_id='r-wpw69b78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-451246924',owner_user_name='tempest-TestMinimumBasicScenario-451246924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:14:27Z,user_data=None,user_id='fcb6dc8c680145809756f79ccc78ead8',uuid=b768391e-9952-4c91-a336-59ac7127b8ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converting VIF {"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.objects.instance [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'pci_devices' on Instance uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:14:29 user nova-compute[76161]:   <uuid>b768391e-9952-4c91-a336-59ac7127b8ca</uuid>
Nov 14 18:14:29 user nova-compute[76161]:   <name>instance-00000031</name>
Nov 14 18:14:29 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:14:29 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:14:29 user nova-compute[76161]:   <metadata>
Nov 14 18:14:29 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:14:29 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:14:29 user nova-compute[76161]:       <nova:name>tempest-TestMinimumBasicScenario-server-1070282106</nova:name>
Nov 14 18:14:29 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:14:29</nova:creationTime>
Nov 14 18:14:29 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:14:29 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:14:29 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:14:29 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:14:29 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:14:29 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:14:29 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:14:29 user nova-compute[76161]:       <nova:owner>
Nov 14 18:14:29 user nova-compute[76161]:         <nova:user uuid="fcb6dc8c680145809756f79ccc78ead8">tempest-TestMinimumBasicScenario-451246924-project-member</nova:user>
Nov 14 18:14:29 user nova-compute[76161]:         <nova:project uuid="83e313849c0b452e9dd6f5afd4006e31">tempest-TestMinimumBasicScenario-451246924</nova:project>
Nov 14 18:14:29 user nova-compute[76161]:       </nova:owner>
Nov 14 18:14:29 user nova-compute[76161]:       <nova:root type="image" uuid="7640a2d0-54ea-4669-a8db-a1f48011dda6"/>
Nov 14 18:14:29 user nova-compute[76161]:       <nova:ports>
Nov 14 18:14:29 user nova-compute[76161]:         <nova:port uuid="85a65a97-cac5-41c2-9943-4cbc64cb9c21">
Nov 14 18:14:29 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 18:14:29 user nova-compute[76161]:         </nova:port>
Nov 14 18:14:29 user nova-compute[76161]:       </nova:ports>
Nov 14 18:14:29 user nova-compute[76161]:     </nova:instance>
Nov 14 18:14:29 user nova-compute[76161]:   </metadata>
Nov 14 18:14:29 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:14:29 user nova-compute[76161]:     <system>
Nov 14 18:14:29 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:14:29 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:14:29 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:14:29 user nova-compute[76161]:       <entry name="serial">b768391e-9952-4c91-a336-59ac7127b8ca</entry>
Nov 14 18:14:29 user nova-compute[76161]:       <entry name="uuid">b768391e-9952-4c91-a336-59ac7127b8ca</entry>
Nov 14 18:14:29 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:14:29 user nova-compute[76161]:     </system>
Nov 14 18:14:29 user nova-compute[76161]:   </sysinfo>
Nov 14 18:14:29 user nova-compute[76161]:   <os>
Nov 14 18:14:29 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:14:29 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:14:29 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:14:29 user nova-compute[76161]:   </os>
Nov 14 18:14:29 user nova-compute[76161]:   <features>
Nov 14 18:14:29 user nova-compute[76161]:     <acpi/>
Nov 14 18:14:29 user nova-compute[76161]:     <apic/>
Nov 14 18:14:29 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:14:29 user nova-compute[76161]:   </features>
Nov 14 18:14:29 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:14:29 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:14:29 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:14:29 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:14:29 user nova-compute[76161]:   </clock>
Nov 14 18:14:29 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:14:29 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:14:29 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:14:29 user nova-compute[76161]:   </cpu>
Nov 14 18:14:29 user nova-compute[76161]:   <devices>
Nov 14 18:14:29 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:14:29 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:14:29 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk"/>
Nov 14 18:14:29 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:14:29 user nova-compute[76161]:     </disk>
Nov 14 18:14:29 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:14:29 user nova-compute[76161]:       <mac address="fa:16:3e:7a:38:21"/>
Nov 14 18:14:29 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:14:29 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:14:29 user nova-compute[76161]:       <target dev="tap85a65a97-ca"/>
Nov 14 18:14:29 user nova-compute[76161]:     </interface>
Nov 14 18:14:29 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:14:29 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/console.log" append="off"/>
Nov 14 18:14:29 user nova-compute[76161]:     </serial>
Nov 14 18:14:29 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:14:29 user nova-compute[76161]:     <video>
Nov 14 18:14:29 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:14:29 user nova-compute[76161]:     </video>
Nov 14 18:14:29 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:14:29 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:14:29 user nova-compute[76161]:     </rng>
Nov 14 18:14:29 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:14:29 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:14:29 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:14:29 user nova-compute[76161]:     </memballoon>
Nov 14 18:14:29 user nova-compute[76161]:   </devices>
Nov 14 18:14:29 user nova-compute[76161]: </domain>
Nov 14 18:14:29 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1070282106',display_name='tempest-TestMinimumBasicScenario-server-1070282106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1070282106',id=49,image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjEeSYdg8v8pt4SmYmzNQO5ZL1McegI+xu8cN/VHJTsi7Bn6WW6HjSG4OAYHkziGNE2clc6cJDmcYgvtcc5fazdsZIGzLsPjKOgooFUT+gajlYmF81p6ViKBNYNiRyEJA==',key_name='tempest-TestMinimumBasicScenario-1264911207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e313849c0b452e9dd6f5afd4006e31',ramdisk_id='',reservation_id='r-wpw69b78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-451246924',owner_user_name='tempest-TestMinimumBasicScenario-451246924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:14:27Z,user_data=None,user_id='fcb6dc8c680145809756f79ccc78ead8',uuid=b768391e-9952-4c91-a336-59ac7127b8ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converting VIF {"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG os_vif [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba4b72b7-5102-5e5d-b57a-02966bf947a4', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85a65a97-ca, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85a65a97-ca, col_values=(('qos', UUID('c2822e1b-89fa-43fb-a25c-e1e1f45c42c8')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85a65a97-ca, col_values=(('external_ids', {'iface-id': '85a65a97-cac5-41c2-9943-4cbc64cb9c21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:38:21', 'vm-uuid': 'b768391e-9952-4c91-a336-59ac7127b8ca'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:29 user nova-compute[76161]: INFO os_vif [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca')
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] No VIF found with MAC fa:16:3e:7a:38:21, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.network.neutron [req-c89b720c-b384-49da-ba0a-45d7addc46ba req-d5bdae3f-5175-4e15-88f8-fddf87450988 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updated VIF entry in instance network info cache for port 85a65a97-cac5-41c2-9943-4cbc64cb9c21. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG nova.network.neutron [req-c89b720c-b384-49da-ba0a-45d7addc46ba req-d5bdae3f-5175-4e15-88f8-fddf87450988 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updating instance_info_cache with network_info: [{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:14:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c89b720c-b384-49da-ba0a-45d7addc46ba req-d5bdae3f-5175-4e15-88f8-fddf87450988 service nova] Releasing lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-66caac62-f316-4b77-bc11-fbdfc3a0feae req-47390621-1bc1-4fe3-b96d-d03c9f6cc1d5 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-66caac62-f316-4b77-bc11-fbdfc3a0feae req-47390621-1bc1-4fe3-b96d-d03c9f6cc1d5 service nova] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-66caac62-f316-4b77-bc11-fbdfc3a0feae req-47390621-1bc1-4fe3-b96d-d03c9f6cc1d5 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-66caac62-f316-4b77-bc11-fbdfc3a0feae req-47390621-1bc1-4fe3-b96d-d03c9f6cc1d5 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.compute.manager [req-66caac62-f316-4b77-bc11-fbdfc3a0feae req-47390621-1bc1-4fe3-b96d-d03c9f6cc1d5 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] No waiting events found dispatching network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:30 user nova-compute[76161]: WARNING nova.compute.manager [req-66caac62-f316-4b77-bc11-fbdfc3a0feae req-47390621-1bc1-4fe3-b96d-d03c9f6cc1d5 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received unexpected event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 for instance with vm_state building and task_state spawning.
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:14:30 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Creating image(s)
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Ensure instance console log exists: /opt/stack/data/nova/instances/edd8f8ce-4a4a-4770-87c4-becece86b2d8/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Start _get_guest_xml network_info=[{"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnCHeIof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edd8f8ce-4a4a-4770-87c4-becece86b2d8', 'attached_at': '', 'detached_at': '', 'volume_id': '78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 'serial': '78b45bd9-d89b-4ed9-a248-f2bebec9e71e'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'a4cd2f4b-65c0-4d34-a2fa-50f75a7ab690', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:14:30 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:14:30 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnCHeIof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:14:30 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:14:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:14:30 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:14:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:14:30 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[04659370-eb27-4998-bc28-616391173e27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:14:30 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:14:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c47970-6aad-4e4e-b86e-34c48255bb1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e] added
Nov 14 18:14:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fcda5d-c6de-4ab3-80eb-9aa815252d53]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[023655bd-dacb-48d0-b432-1fc3ec5cbedf]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnCHeIof {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UnCHeIof" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90c6d88-a11c-42ee-81d2-8d6f1921a18c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UnCHeIof'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c37121-ea85-413a-9931-d1dcbd3b8254]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6e8c9e-698c-4e70-8870-93739efeddd2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:14:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:14:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc37a58-76d7-4b93-b771-69c79e998ea9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260]
Nov 14 18:14:31 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260] successful.
Nov 14 18:14:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebab669-d350-4185-abc3-cbbfd5bf0a11]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[704b6042-2ca4-4f69-8917-c9c2a3e45c60]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:14:31 user nova-compute[76161]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:14:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:14:31 user nova-compute[76161]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:14:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eadb5f-5e3d-4695-9ccd-dc59d3b9d210]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:14:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnCHeIof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23232653930646462', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232653930646462', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1848715146',display_name='tempest-TestVolumeBootPattern-server-1848715146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1848715146',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHVYDN2Xftf5V1grXUvkOAuZ4lRy2Yu8x71x7XZMVIMR4I5qKGZtkFKrVxApclfxwZHmCeNjcLNUIFGzVbzrwECoYdV2hlra8hiYCIDqSv04geiOynO7IsegUM2gQdCg==',key_name='tempest-TestVolumeBootPattern-706510423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-8fomdp3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:14:26Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=edd8f8ce-4a4a-4770-87c4-becece86b2d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:62:f4,bridge_name='br-int',has_traffic_filtering=True,id=0c711a49-404c-480b-87e1-dc2560ad2844,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c711a49-40') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'pci_devices' on Instance uuid edd8f8ce-4a4a-4770-87c4-becece86b2d8 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:14:32 user nova-compute[76161]:   <uuid>edd8f8ce-4a4a-4770-87c4-becece86b2d8</uuid>
Nov 14 18:14:32 user nova-compute[76161]:   <name>instance-00000030</name>
Nov 14 18:14:32 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:14:32 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:14:32 user nova-compute[76161]:   <metadata>
Nov 14 18:14:32 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:14:32 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:14:32 user nova-compute[76161]:       <nova:name>tempest-TestVolumeBootPattern-server-1848715146</nova:name>
Nov 14 18:14:32 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:14:30</nova:creationTime>
Nov 14 18:14:32 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:14:32 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:14:32 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:14:32 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:14:32 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:14:32 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:14:32 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:14:32 user nova-compute[76161]:       <nova:owner>
Nov 14 18:14:32 user nova-compute[76161]:         <nova:user uuid="d22a86988e6043d2ab950e0d6e557ef8">tempest-TestVolumeBootPattern-1727647616-project-member</nova:user>
Nov 14 18:14:32 user nova-compute[76161]:         <nova:project uuid="81682e21827c4572b1659004cc22215a">tempest-TestVolumeBootPattern-1727647616</nova:project>
Nov 14 18:14:32 user nova-compute[76161]:       </nova:owner>
Nov 14 18:14:32 user nova-compute[76161]:       <nova:ports>
Nov 14 18:14:32 user nova-compute[76161]:         <nova:port uuid="0c711a49-404c-480b-87e1-dc2560ad2844">
Nov 14 18:14:32 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 18:14:32 user nova-compute[76161]:         </nova:port>
Nov 14 18:14:32 user nova-compute[76161]:       </nova:ports>
Nov 14 18:14:32 user nova-compute[76161]:     </nova:instance>
Nov 14 18:14:32 user nova-compute[76161]:   </metadata>
Nov 14 18:14:32 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:14:32 user nova-compute[76161]:     <system>
Nov 14 18:14:32 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:14:32 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:14:32 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:14:32 user nova-compute[76161]:       <entry name="serial">edd8f8ce-4a4a-4770-87c4-becece86b2d8</entry>
Nov 14 18:14:32 user nova-compute[76161]:       <entry name="uuid">edd8f8ce-4a4a-4770-87c4-becece86b2d8</entry>
Nov 14 18:14:32 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:14:32 user nova-compute[76161]:     </system>
Nov 14 18:14:32 user nova-compute[76161]:   </sysinfo>
Nov 14 18:14:32 user nova-compute[76161]:   <os>
Nov 14 18:14:32 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:14:32 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:14:32 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:14:32 user nova-compute[76161]:   </os>
Nov 14 18:14:32 user nova-compute[76161]:   <features>
Nov 14 18:14:32 user nova-compute[76161]:     <acpi/>
Nov 14 18:14:32 user nova-compute[76161]:     <apic/>
Nov 14 18:14:32 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:14:32 user nova-compute[76161]:   </features>
Nov 14 18:14:32 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:14:32 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:14:32 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:14:32 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:14:32 user nova-compute[76161]:   </clock>
Nov 14 18:14:32 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:14:32 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:14:32 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:14:32 user nova-compute[76161]:   </cpu>
Nov 14 18:14:32 user nova-compute[76161]:   <devices>
Nov 14 18:14:32 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:14:32 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:14:32 user nova-compute[76161]:       <source dev="/dev/sdb"/>
Nov 14 18:14:32 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:14:32 user nova-compute[76161]:       <serial>78b45bd9-d89b-4ed9-a248-f2bebec9e71e</serial>
Nov 14 18:14:32 user nova-compute[76161]:     </disk>
Nov 14 18:14:32 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:14:32 user nova-compute[76161]:       <mac address="fa:16:3e:3b:62:f4"/>
Nov 14 18:14:32 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:14:32 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:14:32 user nova-compute[76161]:       <target dev="tap0c711a49-40"/>
Nov 14 18:14:32 user nova-compute[76161]:     </interface>
Nov 14 18:14:32 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:14:32 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/edd8f8ce-4a4a-4770-87c4-becece86b2d8/console.log" append="off"/>
Nov 14 18:14:32 user nova-compute[76161]:     </serial>
Nov 14 18:14:32 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:14:32 user nova-compute[76161]:     <video>
Nov 14 18:14:32 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:14:32 user nova-compute[76161]:     </video>
Nov 14 18:14:32 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:14:32 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:14:32 user nova-compute[76161]:     </rng>
Nov 14 18:14:32 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:14:32 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:14:32 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:14:32 user nova-compute[76161]:     </memballoon>
Nov 14 18:14:32 user nova-compute[76161]:   </devices>
Nov 14 18:14:32 user nova-compute[76161]: </domain>
Nov 14 18:14:32 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1848715146',display_name='tempest-TestVolumeBootPattern-server-1848715146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1848715146',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHVYDN2Xftf5V1grXUvkOAuZ4lRy2Yu8x71x7XZMVIMR4I5qKGZtkFKrVxApclfxwZHmCeNjcLNUIFGzVbzrwECoYdV2hlra8hiYCIDqSv04geiOynO7IsegUM2gQdCg==',key_name='tempest-TestVolumeBootPattern-706510423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-8fomdp3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:14:26Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=edd8f8ce-4a4a-4770-87c4-becece86b2d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:62:f4,bridge_name='br-int',has_traffic_filtering=True,id=0c711a49-404c-480b-87e1-dc2560ad2844,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c711a49-40') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG os_vif [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:62:f4,bridge_name='br-int',has_traffic_filtering=True,id=0c711a49-404c-480b-87e1-dc2560ad2844,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c711a49-40') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d832bce-d396-52df-b53b-64775bab4897', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c711a49-40, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c711a49-40, col_values=(('qos', UUID('62214763-65fa-4a21-b3e9-33ed2371b345')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c711a49-40, col_values=(('external_ids', {'iface-id': '0c711a49-404c-480b-87e1-dc2560ad2844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:62:f4', 'vm-uuid': 'edd8f8ce-4a4a-4770-87c4-becece86b2d8'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:32 user nova-compute[76161]: INFO os_vif [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:62:f4,bridge_name='br-int',has_traffic_filtering=True,id=0c711a49-404c-480b-87e1-dc2560ad2844,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c711a49-40')
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No VIF found with MAC fa:16:3e:3b:62:f4, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:14:32 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Instance spawned successfully.
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:32 user nova-compute[76161]: INFO nova.compute.manager [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-140ae482-0674-454c-8ccf-8c71c1437153 req-b4a1d7fa-c2d5-4911-9c1e-6f6fca18af15 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-140ae482-0674-454c-8ccf-8c71c1437153 req-b4a1d7fa-c2d5-4911-9c1e-6f6fca18af15 service nova] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-140ae482-0674-454c-8ccf-8c71c1437153 req-b4a1d7fa-c2d5-4911-9c1e-6f6fca18af15 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-140ae482-0674-454c-8ccf-8c71c1437153 req-b4a1d7fa-c2d5-4911-9c1e-6f6fca18af15 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:32 user nova-compute[76161]: DEBUG nova.compute.manager [req-140ae482-0674-454c-8ccf-8c71c1437153 req-b4a1d7fa-c2d5-4911-9c1e-6f6fca18af15 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] No waiting events found dispatching network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:32 user nova-compute[76161]: WARNING nova.compute.manager [req-140ae482-0674-454c-8ccf-8c71c1437153 req-b4a1d7fa-c2d5-4911-9c1e-6f6fca18af15 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received unexpected event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 for instance with vm_state building and task_state spawning.
Nov 14 18:14:32 user nova-compute[76161]: INFO nova.compute.manager [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Took 6.32 seconds to build instance.
Nov 14 18:14:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-33756f24-b768-46c5-9521-b86588d8ccb7 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.419s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:33 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:14:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received event network-vif-plugged-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] Acquiring lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] No waiting events found dispatching network-vif-plugged-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:34 user nova-compute[76161]: WARNING nova.compute.manager [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received unexpected event network-vif-plugged-0c711a49-404c-480b-87e1-dc2560ad2844 for instance with vm_state building and task_state spawning.
Nov 14 18:14:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received event network-vif-plugged-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] Acquiring lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] No waiting events found dispatching network-vif-plugged-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:14:34 user nova-compute[76161]: WARNING nova.compute.manager [req-fb1ffe22-eaaf-415c-8954-e1758a772928 req-a49862bd-4305-408c-b51c-d845e48c80a4 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received unexpected event network-vif-plugged-0c711a49-404c-480b-87e1-dc2560ad2844 for instance with vm_state building and task_state spawning.
Nov 14 18:14:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:35 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:14:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:14:35 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Instance spawned successfully.
Nov 14 18:14:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:14:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:14:35 user nova-compute[76161]: INFO nova.compute.manager [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 14 18:14:35 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:14:36 user nova-compute[76161]: INFO nova.compute.manager [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Took 10.40 seconds to build instance.
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c8343cec-ff88-482d-91f1-c1a1b90a3e6a tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.490s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:38 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:14:39 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:14:39 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8471MB free_disk=24.9454345703125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance de90c284-3d97-42c6-9692-cdac8eccd2ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance edd8f8ce-4a4a-4770-87c4-becece86b2d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b768391e-9952-4c91-a336-59ac7127b8ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:14:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:14:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:14:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:14:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:57 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:14:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:57 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:14:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:57 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:57 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:14:57 user nova-compute[76161]: INFO nova.compute.claims [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Claim successful on node user
Nov 14 18:14:58 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:14:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:14:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG nova.policy [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f74d7304b3e40c389c28e84361ce1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64059d5429f2468f8dbcc256a47a5957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:14:58 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Creating image(s)
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "/opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "/opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk 1073741824" returned: 0 in 0.046s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:58 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Successfully created port: a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.214s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Cannot resize image /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Ensure instance console log exists: /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Successfully updated port: a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "refresh_cache-cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquired lock "refresh_cache-cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-c681704c-93bc-441d-8b0f-f23179656843 req-d69a5341-2b1f-4a8a-9762-03e43d4f9238 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received event network-changed-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG nova.compute.manager [req-c681704c-93bc-441d-8b0f-f23179656843 req-d69a5341-2b1f-4a8a-9762-03e43d4f9238 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Refreshing instance network info cache due to event network-changed-a800e21d-ec45-4779-8901-2720815620b4. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c681704c-93bc-441d-8b0f-f23179656843 req-d69a5341-2b1f-4a8a-9762-03e43d4f9238 service nova] Acquiring lock "refresh_cache-cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:14:59 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.network.neutron [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Updating instance_info_cache with network_info: [{"id": "a800e21d-ec45-4779-8901-2720815620b4", "address": "fa:16:3e:3e:25:7e", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa800e21d-ec", "ovs_interfaceid": "a800e21d-ec45-4779-8901-2720815620b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Releasing lock "refresh_cache-cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Instance network_info: |[{"id": "a800e21d-ec45-4779-8901-2720815620b4", "address": "fa:16:3e:3e:25:7e", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa800e21d-ec", "ovs_interfaceid": "a800e21d-ec45-4779-8901-2720815620b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c681704c-93bc-441d-8b0f-f23179656843 req-d69a5341-2b1f-4a8a-9762-03e43d4f9238 service nova] Acquired lock "refresh_cache-cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.network.neutron [req-c681704c-93bc-441d-8b0f-f23179656843 req-d69a5341-2b1f-4a8a-9762-03e43d4f9238 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Refreshing network info cache for port a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Start _get_guest_xml network_info=[{"id": "a800e21d-ec45-4779-8901-2720815620b4", "address": "fa:16:3e:3e:25:7e", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa800e21d-ec", "ovs_interfaceid": "a800e21d-ec45-4779-8901-2720815620b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:15:00 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:15:00 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1296818343',display_name='tempest-VolumesActionsTest-instance-1296818343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1296818343',id=50,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64059d5429f2468f8dbcc256a47a5957',ramdisk_id='',reservation_id='r-buok93xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1577186745',owner_user_name='tempest-VolumesActionsTest-1577186745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:14:58Z,user_data=None,user_id='0f74d7304b3e40c389c28e84361ce1a0',uuid=cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a800e21d-ec45-4779-8901-2720815620b4", "address": "fa:16:3e:3e:25:7e", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa800e21d-ec", "ovs_interfaceid": "a800e21d-ec45-4779-8901-2720815620b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converting VIF {"id": "a800e21d-ec45-4779-8901-2720815620b4", "address": "fa:16:3e:3e:25:7e", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa800e21d-ec", "ovs_interfaceid": "a800e21d-ec45-4779-8901-2720815620b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:25:7e,bridge_name='br-int',has_traffic_filtering=True,id=a800e21d-ec45-4779-8901-2720815620b4,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa800e21d-ec') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.objects.instance [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lazy-loading 'pci_devices' on Instance uuid cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:15:00 user nova-compute[76161]:   <uuid>cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9</uuid>
Nov 14 18:15:00 user nova-compute[76161]:   <name>instance-00000032</name>
Nov 14 18:15:00 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:15:00 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:15:00 user nova-compute[76161]:   <metadata>
Nov 14 18:15:00 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:15:00 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:15:00 user nova-compute[76161]:       <nova:name>tempest-VolumesActionsTest-instance-1296818343</nova:name>
Nov 14 18:15:00 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:15:00</nova:creationTime>
Nov 14 18:15:00 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:15:00 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:15:00 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:15:00 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:15:00 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:15:00 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:15:00 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:15:00 user nova-compute[76161]:       <nova:owner>
Nov 14 18:15:00 user nova-compute[76161]:         <nova:user uuid="0f74d7304b3e40c389c28e84361ce1a0">tempest-VolumesActionsTest-1577186745-project-member</nova:user>
Nov 14 18:15:00 user nova-compute[76161]:         <nova:project uuid="64059d5429f2468f8dbcc256a47a5957">tempest-VolumesActionsTest-1577186745</nova:project>
Nov 14 18:15:00 user nova-compute[76161]:       </nova:owner>
Nov 14 18:15:00 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:15:00 user nova-compute[76161]:       <nova:ports>
Nov 14 18:15:00 user nova-compute[76161]:         <nova:port uuid="a800e21d-ec45-4779-8901-2720815620b4">
Nov 14 18:15:00 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 18:15:00 user nova-compute[76161]:         </nova:port>
Nov 14 18:15:00 user nova-compute[76161]:       </nova:ports>
Nov 14 18:15:00 user nova-compute[76161]:     </nova:instance>
Nov 14 18:15:00 user nova-compute[76161]:   </metadata>
Nov 14 18:15:00 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:15:00 user nova-compute[76161]:     <system>
Nov 14 18:15:00 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:15:00 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:15:00 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:15:00 user nova-compute[76161]:       <entry name="serial">cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9</entry>
Nov 14 18:15:00 user nova-compute[76161]:       <entry name="uuid">cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9</entry>
Nov 14 18:15:00 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:15:00 user nova-compute[76161]:     </system>
Nov 14 18:15:00 user nova-compute[76161]:   </sysinfo>
Nov 14 18:15:00 user nova-compute[76161]:   <os>
Nov 14 18:15:00 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:15:00 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:15:00 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:15:00 user nova-compute[76161]:   </os>
Nov 14 18:15:00 user nova-compute[76161]:   <features>
Nov 14 18:15:00 user nova-compute[76161]:     <acpi/>
Nov 14 18:15:00 user nova-compute[76161]:     <apic/>
Nov 14 18:15:00 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:15:00 user nova-compute[76161]:   </features>
Nov 14 18:15:00 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:15:00 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:15:00 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:15:00 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:15:00 user nova-compute[76161]:   </clock>
Nov 14 18:15:00 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:15:00 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:15:00 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:15:00 user nova-compute[76161]:   </cpu>
Nov 14 18:15:00 user nova-compute[76161]:   <devices>
Nov 14 18:15:00 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:15:00 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:15:00 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk"/>
Nov 14 18:15:00 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:15:00 user nova-compute[76161]:     </disk>
Nov 14 18:15:00 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:15:00 user nova-compute[76161]:       <mac address="fa:16:3e:3e:25:7e"/>
Nov 14 18:15:00 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:15:00 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:15:00 user nova-compute[76161]:       <target dev="tapa800e21d-ec"/>
Nov 14 18:15:00 user nova-compute[76161]:     </interface>
Nov 14 18:15:00 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:15:00 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/console.log" append="off"/>
Nov 14 18:15:00 user nova-compute[76161]:     </serial>
Nov 14 18:15:00 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:15:00 user nova-compute[76161]:     <video>
Nov 14 18:15:00 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:15:00 user nova-compute[76161]:     </video>
Nov 14 18:15:00 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:15:00 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:15:00 user nova-compute[76161]:     </rng>
Nov 14 18:15:00 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:15:00 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:15:00 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:15:00 user nova-compute[76161]:     </memballoon>
Nov 14 18:15:00 user nova-compute[76161]:   </devices>
Nov 14 18:15:00 user nova-compute[76161]: </domain>
Nov 14 18:15:00 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1296818343',display_name='tempest-VolumesActionsTest-instance-1296818343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1296818343',id=50,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64059d5429f2468f8dbcc256a47a5957',ramdisk_id='',reservation_id='r-buok93xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1577186745',owner_user_name='tempest-VolumesActionsTest-1577186745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:14:58Z,user_data=None,user_id='0f74d7304b3e40c389c28e84361ce1a0',uuid=cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a800e21d-ec45-4779-8901-2720815620b4", "address": "fa:16:3e:3e:25:7e", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa800e21d-ec", "ovs_interfaceid": "a800e21d-ec45-4779-8901-2720815620b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converting VIF {"id": "a800e21d-ec45-4779-8901-2720815620b4", "address": "fa:16:3e:3e:25:7e", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa800e21d-ec", "ovs_interfaceid": "a800e21d-ec45-4779-8901-2720815620b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:25:7e,bridge_name='br-int',has_traffic_filtering=True,id=a800e21d-ec45-4779-8901-2720815620b4,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa800e21d-ec') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG os_vif [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:25:7e,bridge_name='br-int',has_traffic_filtering=True,id=a800e21d-ec45-4779-8901-2720815620b4,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa800e21d-ec') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a4122dc-4c18-523e-bf46-8333d433117d', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa800e21d-ec, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa800e21d-ec, col_values=(('qos', UUID('c73fdeeb-95dc-404c-9bac-847608ab0cad')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa800e21d-ec, col_values=(('external_ids', {'iface-id': 'a800e21d-ec45-4779-8901-2720815620b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:25:7e', 'vm-uuid': 'cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:00 user nova-compute[76161]: INFO os_vif [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:25:7e,bridge_name='br-int',has_traffic_filtering=True,id=a800e21d-ec45-4779-8901-2720815620b4,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa800e21d-ec')
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] No VIF found with MAC fa:16:3e:3e:25:7e, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.network.neutron [req-c681704c-93bc-441d-8b0f-f23179656843 req-d69a5341-2b1f-4a8a-9762-03e43d4f9238 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Updated VIF entry in instance network info cache for port a800e21d-ec45-4779-8901-2720815620b4. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG nova.network.neutron [req-c681704c-93bc-441d-8b0f-f23179656843 req-d69a5341-2b1f-4a8a-9762-03e43d4f9238 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Updating instance_info_cache with network_info: [{"id": "a800e21d-ec45-4779-8901-2720815620b4", "address": "fa:16:3e:3e:25:7e", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa800e21d-ec", "ovs_interfaceid": "a800e21d-ec45-4779-8901-2720815620b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:15:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c681704c-93bc-441d-8b0f-f23179656843 req-d69a5341-2b1f-4a8a-9762-03e43d4f9238 service nova] Releasing lock "refresh_cache-cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:15:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-e71bbd96-a4ef-437d-a74e-5e0e460e5c5a req-16d2ba27-81df-4a7a-aa6b-4c78cf370975 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received event network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e71bbd96-a4ef-437d-a74e-5e0e460e5c5a req-16d2ba27-81df-4a7a-aa6b-4c78cf370975 service nova] Acquiring lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e71bbd96-a4ef-437d-a74e-5e0e460e5c5a req-16d2ba27-81df-4a7a-aa6b-4c78cf370975 service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e71bbd96-a4ef-437d-a74e-5e0e460e5c5a req-16d2ba27-81df-4a7a-aa6b-4c78cf370975 service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-e71bbd96-a4ef-437d-a74e-5e0e460e5c5a req-16d2ba27-81df-4a7a-aa6b-4c78cf370975 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] No waiting events found dispatching network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:02 user nova-compute[76161]: WARNING nova.compute.manager [req-e71bbd96-a4ef-437d-a74e-5e0e460e5c5a req-16d2ba27-81df-4a7a-aa6b-4c78cf370975 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received unexpected event network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 for instance with vm_state building and task_state spawning.
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:02 user nova-compute[76161]: INFO nova.compute.manager [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Terminating instance
Nov 14 18:15:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-b617180a-e8ce-4f82-993a-66b3824c4a1e req-2921293c-7be6-4c75-93ba-d0bda1e00252 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-unplugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b617180a-e8ce-4f82-993a-66b3824c4a1e req-2921293c-7be6-4c75-93ba-d0bda1e00252 service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b617180a-e8ce-4f82-993a-66b3824c4a1e req-2921293c-7be6-4c75-93ba-d0bda1e00252 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b617180a-e8ce-4f82-993a-66b3824c4a1e req-2921293c-7be6-4c75-93ba-d0bda1e00252 service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-b617180a-e8ce-4f82-993a-66b3824c4a1e req-2921293c-7be6-4c75-93ba-d0bda1e00252 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-unplugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-b617180a-e8ce-4f82-993a-66b3824c4a1e req-2921293c-7be6-4c75-93ba-d0bda1e00252 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-unplugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Instance destroyed successfully.
Nov 14 18:15:02 user nova-compute[76161]: DEBUG nova.objects.instance [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'resources' on Instance uuid de90c284-3d97-42c6-9692-cdac8eccd2ef {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296589707',display_name='tempest-ServerRescueNegativeTestJSON-server-296589707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296589707',id=31,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-hz0wi1so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:01:00Z,user_data=None,user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=de90c284-3d97-42c6-9692-cdac8eccd2ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "address": "fa:16:3e:9c:eb:17", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec07d878-8c", "ovs_interfaceid": "ec07d878-8c19-4c35-bc46-ba1bf514cf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:eb:17,bridge_name='br-int',has_traffic_filtering=True,id=ec07d878-8c19-4c35-bc46-ba1bf514cf60,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec07d878-8c') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG os_vif [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:eb:17,bridge_name='br-int',has_traffic_filtering=True,id=ec07d878-8c19-4c35-bc46-ba1bf514cf60,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec07d878-8c') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec07d878-8c, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=335801f0-d085-4d17-b1dc-40fe51d0a994) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:02 user nova-compute[76161]: INFO os_vif [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:eb:17,bridge_name='br-int',has_traffic_filtering=True,id=ec07d878-8c19-4c35-bc46-ba1bf514cf60,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec07d878-8c')
Nov 14 18:15:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Deleting instance files /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef_del
Nov 14 18:15:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Deletion of /opt/stack/data/nova/instances/de90c284-3d97-42c6-9692-cdac8eccd2ef_del complete
Nov 14 18:15:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:03 user nova-compute[76161]: INFO nova.compute.manager [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 18:15:03 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:03 user nova-compute[76161]: INFO nova.compute.manager [None req-aaec560a-8bc6-4ab7-b6d9-08eff5ce53ca tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Unrescuing
Nov 14 18:15:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aaec560a-8bc6-4ab7-b6d9-08eff5ce53ca tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aaec560a-8bc6-4ab7-b6d9-08eff5ce53ca tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquired lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG nova.network.neutron [None req-aaec560a-8bc6-4ab7-b6d9-08eff5ce53ca tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:15:03 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Took 0.60 seconds to deallocate network for instance.
Nov 14 18:15:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:03 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Deleted allocations for instance de90c284-3d97-42c6-9692-cdac8eccd2ef
Nov 14 18:15:03 user nova-compute[76161]: DEBUG nova.network.neutron [None req-aaec560a-8bc6-4ab7-b6d9-08eff5ce53ca tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updating instance_info_cache with network_info: [{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-aaec560a-8bc6-4ab7-b6d9-08eff5ce53ca tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Releasing lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG nova.objects.instance [None req-aaec560a-8bc6-4ab7-b6d9-08eff5ce53ca tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'flavor' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:15:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-e3680dfb-183d-4762-8410-90c085502a1c tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.877s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:04 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Instance spawned successfully.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-d6ac44c0-ef14-4fab-bd56-229d2e8600f7 req-1e11832b-d7e1-4d7e-a734-ca75a4ab5119 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received event network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d6ac44c0-ef14-4fab-bd56-229d2e8600f7 req-1e11832b-d7e1-4d7e-a734-ca75a4ab5119 service nova] Acquiring lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d6ac44c0-ef14-4fab-bd56-229d2e8600f7 req-1e11832b-d7e1-4d7e-a734-ca75a4ab5119 service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d6ac44c0-ef14-4fab-bd56-229d2e8600f7 req-1e11832b-d7e1-4d7e-a734-ca75a4ab5119 service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-d6ac44c0-ef14-4fab-bd56-229d2e8600f7 req-1e11832b-d7e1-4d7e-a734-ca75a4ab5119 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] No waiting events found dispatching network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:04 user nova-compute[76161]: WARNING nova.compute.manager [req-d6ac44c0-ef14-4fab-bd56-229d2e8600f7 req-1e11832b-d7e1-4d7e-a734-ca75a4ab5119 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received unexpected event network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 for instance with vm_state building and task_state spawning.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-d6ac44c0-ef14-4fab-bd56-229d2e8600f7 req-1e11832b-d7e1-4d7e-a734-ca75a4ab5119 service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-deleted-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:15:04 user nova-compute[76161]: INFO nova.compute.manager [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:15:04 user nova-compute[76161]: INFO nova.compute.manager [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Took 6.51 seconds to build instance.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4c787230-2eba-455e-9b03-5f0ca745e3fa tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.615s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:04 user nova-compute[76161]: WARNING nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state deleted and task_state None.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:04 user nova-compute[76161]: WARNING nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state deleted and task_state None.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:04 user nova-compute[76161]: WARNING nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state deleted and task_state None.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-unplugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-unplugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:04 user nova-compute[76161]: WARNING nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-unplugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state deleted and task_state None.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Acquiring lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "de90c284-3d97-42c6-9692-cdac8eccd2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] No waiting events found dispatching network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:04 user nova-compute[76161]: WARNING nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: de90c284-3d97-42c6-9692-cdac8eccd2ef] Received unexpected event network-vif-plugged-ec07d878-8c19-4c35-bc46-ba1bf514cf60 for instance with vm_state deleted and task_state None.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-unplugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-unplugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:04 user nova-compute[76161]: WARNING nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-unplugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:04 user nova-compute[76161]: WARNING nova.compute.manager [req-62fbc6b2-b45e-405e-b476-2efe9cab9369 req-81f1b739-ae04-4725-9e0e-0c3ba4d0427d service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-dfab8036-ae7c-4e47-ad1d-cc5dd3ff9773 req-d4a3ec33-3bbb-4bb7-986e-d9f2e3b5e4fb service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-changed-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-dfab8036-ae7c-4e47-ad1d-cc5dd3ff9773 req-d4a3ec33-3bbb-4bb7-986e-d9f2e3b5e4fb service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Refreshing instance network info cache due to event network-changed-99e841f1-c43d-40dc-9376-8f64d20e4f15. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dfab8036-ae7c-4e47-ad1d-cc5dd3ff9773 req-d4a3ec33-3bbb-4bb7-986e-d9f2e3b5e4fb service nova] Acquiring lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dfab8036-ae7c-4e47-ad1d-cc5dd3ff9773 req-d4a3ec33-3bbb-4bb7-986e-d9f2e3b5e4fb service nova] Acquired lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.network.neutron [req-dfab8036-ae7c-4e47-ad1d-cc5dd3ff9773 req-d4a3ec33-3bbb-4bb7-986e-d9f2e3b5e4fb service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Refreshing network info cache for port 99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:15:04 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Instance destroyed successfully.
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.network.neutron [req-dfab8036-ae7c-4e47-ad1d-cc5dd3ff9773 req-d4a3ec33-3bbb-4bb7-986e-d9f2e3b5e4fb service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updated VIF entry in instance network info cache for port 99e841f1-c43d-40dc-9376-8f64d20e4f15. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG nova.network.neutron [req-dfab8036-ae7c-4e47-ad1d-cc5dd3ff9773 req-d4a3ec33-3bbb-4bb7-986e-d9f2e3b5e4fb service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updating instance_info_cache with network_info: [{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:15:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dfab8036-ae7c-4e47-ad1d-cc5dd3ff9773 req-d4a3ec33-3bbb-4bb7-986e-d9f2e3b5e4fb service nova] Releasing lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:15:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-30fc2c0e-37a0-4e90-b009-747fe9bfb193 req-54786b5f-8996-4f81-b9fd-7ac429af1f93 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-30fc2c0e-37a0-4e90-b009-747fe9bfb193 req-54786b5f-8996-4f81-b9fd-7ac429af1f93 service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-30fc2c0e-37a0-4e90-b009-747fe9bfb193 req-54786b5f-8996-4f81-b9fd-7ac429af1f93 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-30fc2c0e-37a0-4e90-b009-747fe9bfb193 req-54786b5f-8996-4f81-b9fd-7ac429af1f93 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-30fc2c0e-37a0-4e90-b009-747fe9bfb193 req-54786b5f-8996-4f81-b9fd-7ac429af1f93 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:06 user nova-compute[76161]: WARNING nova.compute.manager [req-30fc2c0e-37a0-4e90-b009-747fe9bfb193 req-54786b5f-8996-4f81-b9fd-7ac429af1f93 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state rescued and task_state unrescuing.
Nov 14 18:15:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f30334f-e8d9-42c2-94e4-e3f1b6a76f2f req-99c1c49d-ba55-4539-8ca5-a612602f9efc service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-changed-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-1f30334f-e8d9-42c2-94e4-e3f1b6a76f2f req-99c1c49d-ba55-4539-8ca5-a612602f9efc service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Refreshing instance network info cache due to event network-changed-99e841f1-c43d-40dc-9376-8f64d20e4f15. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f30334f-e8d9-42c2-94e4-e3f1b6a76f2f req-99c1c49d-ba55-4539-8ca5-a612602f9efc service nova] Acquiring lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f30334f-e8d9-42c2-94e4-e3f1b6a76f2f req-99c1c49d-ba55-4539-8ca5-a612602f9efc service nova] Acquired lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG nova.network.neutron [req-1f30334f-e8d9-42c2-94e4-e3f1b6a76f2f req-99c1c49d-ba55-4539-8ca5-a612602f9efc service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Refreshing network info cache for port 99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG nova.network.neutron [req-1f30334f-e8d9-42c2-94e4-e3f1b6a76f2f req-99c1c49d-ba55-4539-8ca5-a612602f9efc service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updated VIF entry in instance network info cache for port 99e841f1-c43d-40dc-9376-8f64d20e4f15. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:15:06 user nova-compute[76161]: DEBUG nova.network.neutron [req-1f30334f-e8d9-42c2-94e4-e3f1b6a76f2f req-99c1c49d-ba55-4539-8ca5-a612602f9efc service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updating instance_info_cache with network_info: [{"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:15:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1f30334f-e8d9-42c2-94e4-e3f1b6a76f2f req-99c1c49d-ba55-4539-8ca5-a612602f9efc service nova] Releasing lock "refresh_cache-3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:15:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-aaec560a-8bc6-4ab7-b6d9-08eff5ce53ca tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:15:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-e7f80b15-8e3d-4793-a150-d963484b20f2 req-8a563b21-1312-4c04-b71d-01e343c1dc12 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e7f80b15-8e3d-4793-a150-d963484b20f2 req-8a563b21-1312-4c04-b71d-01e343c1dc12 service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e7f80b15-8e3d-4793-a150-d963484b20f2 req-8a563b21-1312-4c04-b71d-01e343c1dc12 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e7f80b15-8e3d-4793-a150-d963484b20f2 req-8a563b21-1312-4c04-b71d-01e343c1dc12 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-e7f80b15-8e3d-4793-a150-d963484b20f2 req-8a563b21-1312-4c04-b71d-01e343c1dc12 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:08 user nova-compute[76161]: WARNING nova.compute.manager [req-e7f80b15-8e3d-4793-a150-d963484b20f2 req-8a563b21-1312-4c04-b71d-01e343c1dc12 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state active and task_state None.
Nov 14 18:15:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:12 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updating instance_info_cache with network_info: [{"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-b223bed6-d3c6-4841-94e3-73adfb708b8a" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:15:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:29 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:31 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:32 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:33 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:36 user nova-compute[76161]: INFO nova.compute.manager [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Detaching volume a6ad57ba-4923-43e9-b584-371f6a390ed3
Nov 14 18:15:36 user nova-compute[76161]: INFO nova.virt.block_device [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Attempting to driver detach volume a6ad57ba-4923-43e9-b584-371f6a390ed3 from mountpoint /dev/vdb
Nov 14 18:15:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Attempting to detach device vdb from instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:15:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:15:36 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:15:36 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:15:36 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:15:36 user nova-compute[76161]:   <serial>a6ad57ba-4923-43e9-b584-371f6a390ed3</serial>
Nov 14 18:15:36 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:15:36 user nova-compute[76161]: </disk>
Nov 14 18:15:36 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:15:36 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Successfully detached device vdb from instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 from the persistent domain config.
Nov 14 18:15:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:15:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:15:36 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:15:36 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:15:36 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:15:36 user nova-compute[76161]:   <serial>a6ad57ba-4923-43e9-b584-371f6a390ed3</serial>
Nov 14 18:15:36 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:15:36 user nova-compute[76161]: </disk>
Nov 14 18:15:36 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:15:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:15:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:38 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:39 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:15:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:15:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8236MB free_disk=24.908451080322266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b223bed6-d3c6-4841-94e3-73adfb708b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance edd8f8ce-4a4a-4770-87c4-becece86b2d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b768391e-9952-4c91-a336-59ac7127b8ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing inventories for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating ProviderTree inventory for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing aggregate associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, aggregates: None {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing trait associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:41 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 18:15:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] There are 0 instances to clean {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid edd8f8ce-4a4a-4770-87c4-becece86b2d8 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Triggering sync for uuid cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9 {{(pid=76161) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:15:48 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:15:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76161) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 18:15:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:52 user nova-compute[76161]: INFO nova.compute.manager [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Terminating instance
Nov 14 18:15:52 user nova-compute[76161]: DEBUG nova.compute.manager [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:15:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-e4f0c7fd-9555-423f-b19d-aaf427e369f7 req-82ff9b55-dd03-4373-8c62-e9ec4cf257fd service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-unplugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e4f0c7fd-9555-423f-b19d-aaf427e369f7 req-82ff9b55-dd03-4373-8c62-e9ec4cf257fd service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e4f0c7fd-9555-423f-b19d-aaf427e369f7 req-82ff9b55-dd03-4373-8c62-e9ec4cf257fd service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-e4f0c7fd-9555-423f-b19d-aaf427e369f7 req-82ff9b55-dd03-4373-8c62-e9ec4cf257fd service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-e4f0c7fd-9555-423f-b19d-aaf427e369f7 req-82ff9b55-dd03-4373-8c62-e9ec4cf257fd service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-unplugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG nova.compute.manager [req-e4f0c7fd-9555-423f-b19d-aaf427e369f7 req-82ff9b55-dd03-4373-8c62-e9ec4cf257fd service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-unplugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Instance destroyed successfully.
Nov 14 18:15:53 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lazy-loading 'resources' on Instance uuid b223bed6-d3c6-4841-94e3-73adfb708b8a {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-482828575',display_name='tempest-ServerRescueNegativeTestJSON-server-482828575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-482828575',id=30,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:03:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='952a823fe4e04963916979f78d5c82a7',ramdisk_id='',reservation_id='r-2w3w7gtf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1787067728',owner_user_name='tempest-ServerRescueNegativeTestJSON-1787067728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:05:41Z,user_data=None,user_id='d463f3fddeba4976bded6ba5abc6c98c',uuid=b223bed6-d3c6-4841-94e3-73adfb708b8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converting VIF {"id": "b4744605-ae45-4625-bdc2-e25dedc542e4", "address": "fa:16:3e:0c:18:db", "network": {"id": "a87a01e5-cc99-496a-aab6-e6536856f2bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-122211410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "952a823fe4e04963916979f78d5c82a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4744605-ae", "ovs_interfaceid": "b4744605-ae45-4625-bdc2-e25dedc542e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:db,bridge_name='br-int',has_traffic_filtering=True,id=b4744605-ae45-4625-bdc2-e25dedc542e4,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744605-ae') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG os_vif [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:db,bridge_name='br-int',has_traffic_filtering=True,id=b4744605-ae45-4625-bdc2-e25dedc542e4,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744605-ae') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4744605-ae, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b178884a-62d0-4a02-960b-af4ca370f9c1) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:15:53 user nova-compute[76161]: INFO os_vif [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:18:db,bridge_name='br-int',has_traffic_filtering=True,id=b4744605-ae45-4625-bdc2-e25dedc542e4,network=Network(a87a01e5-cc99-496a-aab6-e6536856f2bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4744605-ae')
Nov 14 18:15:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Deleting instance files /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a_del
Nov 14 18:15:53 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Deletion of /opt/stack/data/nova/instances/b223bed6-d3c6-4841-94e3-73adfb708b8a_del complete
Nov 14 18:15:53 user nova-compute[76161]: INFO nova.compute.manager [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 18:15:53 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:15:53 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:15:54 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:15:54 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Took 0.38 seconds to deallocate network for instance.
Nov 14 18:15:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:54 user nova-compute[76161]: DEBUG nova.compute.manager [req-e93620c4-6111-437c-b296-7ea841af356f req-4a67666d-8c4e-4060-aa8a-fe63ad194082 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-deleted-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:54 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:15:54 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:15:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:54 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Deleted allocations for instance b223bed6-d3c6-4841-94e3-73adfb708b8a
Nov 14 18:15:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d151fd40-aa33-4cb5-988b-bfa855cbd417 tempest-ServerRescueNegativeTestJSON-1787067728 tempest-ServerRescueNegativeTestJSON-1787067728-project-member] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.606s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-b4e9fe02-7b49-48d6-8489-bece98621a24 req-3903bca0-a4e3-4430-8e77-8f1b40b6f0c5 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:15:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b4e9fe02-7b49-48d6-8489-bece98621a24 req-3903bca0-a4e3-4430-8e77-8f1b40b6f0c5 service nova] Acquiring lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:15:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b4e9fe02-7b49-48d6-8489-bece98621a24 req-3903bca0-a4e3-4430-8e77-8f1b40b6f0c5 service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:55 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b4e9fe02-7b49-48d6-8489-bece98621a24 req-3903bca0-a4e3-4430-8e77-8f1b40b6f0c5 service nova] Lock "b223bed6-d3c6-4841-94e3-73adfb708b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:55 user nova-compute[76161]: DEBUG nova.compute.manager [req-b4e9fe02-7b49-48d6-8489-bece98621a24 req-3903bca0-a4e3-4430-8e77-8f1b40b6f0c5 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] No waiting events found dispatching network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:15:55 user nova-compute[76161]: WARNING nova.compute.manager [req-b4e9fe02-7b49-48d6-8489-bece98621a24 req-3903bca0-a4e3-4430-8e77-8f1b40b6f0c5 service nova] [instance: b223bed6-d3c6-4841-94e3-73adfb708b8a] Received unexpected event network-vif-plugged-b4744605-ae45-4625-bdc2-e25dedc542e4 for instance with vm_state deleted and task_state None.
Nov 14 18:15:57 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 is timed out.
Nov 14 18:15:57 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Successfully detached device vdb from instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 from the live domain config.
Nov 14 18:15:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMuDmZAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:15:57 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[692ec010-c250-4607-863a-b978df451416]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:15:57 user nova-compute[76161]: No targets found.
Nov 14 18:15:57 user nova-compute[76161]: iSNS:
Nov 14 18:15:57 user nova-compute[76161]: No targets found.
Nov 14 18:15:57 user nova-compute[76161]: STATIC:
Nov 14 18:15:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3
Nov 14 18:15:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:15:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:15:57 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e
Nov 14 18:15:57 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:15:57 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:15:57 user nova-compute[76161]: FIRMWARE:
Nov 14 18:15:57 user nova-compute[76161]: No targets found.
Nov 14 18:15:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:15:57 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:15:57 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d50a57-d7ad-49af-86f2-f125cea7965b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f54db3e-aab1-462b-9baf-0aec0f9d1f2e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:15:57 user nova-compute[76161]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:15:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 (non-flash)
Nov 14 18:15:57 user nova-compute[76161]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:15:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0342b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ae6a46-78f6-489b-a9d4-46a18fc2740b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba7be7-232a-4df8-95fd-6f5ada797c99]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[420e19d1-e44e-47ae-b665-9e4e40903b30]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bbdade-e9fa-4569-bd31-b88c4ee456ef]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2618182b-7806-420e-9c2d-ab6801ae89c5]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bdaeca-9ea4-4c9f-828a-c40147d3212b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3, portal: 172.16.0.220,3260]
Nov 14 18:15:57 user nova-compute[76161]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3, portal: 172.16.0.220,3260] successful.
Nov 14 18:15:57 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ad57ba-4923-43e9-b584-371f6a390ed3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[00270792-1cea-4e7f-ade4-dd9e40c76bec]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] <== disconnect_volume: return (295ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:15:57 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:15:58 user nova-compute[76161]: DEBUG nova.objects.instance [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'flavor' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:15:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1c5ffc7f-10a6-4f3e-9ef7-caf043abcea5 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.591s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.887s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:15:58 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:15:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:16:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:16:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:16:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:16:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:16:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:16:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-8af84551-1f19-40ad-92a7-33b880167dbe req-baf01602-d5c0-4635-8d6b-884a5b316987 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received event network-changed-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-8af84551-1f19-40ad-92a7-33b880167dbe req-baf01602-d5c0-4635-8d6b-884a5b316987 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Refreshing instance network info cache due to event network-changed-0c711a49-404c-480b-87e1-dc2560ad2844. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:16:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8af84551-1f19-40ad-92a7-33b880167dbe req-baf01602-d5c0-4635-8d6b-884a5b316987 service nova] Acquiring lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:16:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8af84551-1f19-40ad-92a7-33b880167dbe req-baf01602-d5c0-4635-8d6b-884a5b316987 service nova] Acquired lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:16:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-8af84551-1f19-40ad-92a7-33b880167dbe req-baf01602-d5c0-4635-8d6b-884a5b316987 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Refreshing network info cache for port 0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:16:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-8af84551-1f19-40ad-92a7-33b880167dbe req-baf01602-d5c0-4635-8d6b-884a5b316987 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Updated VIF entry in instance network info cache for port 0c711a49-404c-480b-87e1-dc2560ad2844. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:16:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-8af84551-1f19-40ad-92a7-33b880167dbe req-baf01602-d5c0-4635-8d6b-884a5b316987 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Updating instance_info_cache with network_info: [{"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:16:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8af84551-1f19-40ad-92a7-33b880167dbe req-baf01602-d5c0-4635-8d6b-884a5b316987 service nova] Releasing lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:16:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:18 user nova-compute[76161]: DEBUG nova.objects.instance [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'flavor' on Instance uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:16:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:19 user nova-compute[76161]: INFO nova.compute.manager [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Attaching volume 98a7a461-4fa9-40dc-ab86-1196caf1efe8 to /dev/vdb
Nov 14 18:16:19 user nova-compute[76161]: DEBUG os_brick.utils [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b08dc8f-ad40-4664-9e2d-593e36fa0906]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4950ff-88dd-4e3c-81a8-e781cd74cb2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce1a421-2980-457d-923a-179e1c5d945f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1873272d-7a66-45a7-8fa4-81d26c342ff7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:16:19 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:16:19 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef8f1ad-d8a1-4d24-b72a-47987f0fd5de]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG os_brick.utils [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:16:19 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updating existing volume attachment record: 8ed1556e-16e2-4da4-9199-0be8c4b7d5c6 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:16:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:16:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:21 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:16:21 user nova-compute[76161]: INFO nova.compute.claims [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Claim successful on node user
Nov 14 18:16:21 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:16:21 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:16:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:21 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:16:22 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:16:22 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG nova.policy [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd22a86988e6043d2ab950e0d6e557ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81682e21827c4572b1659004cc22215a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:16:22 user nova-compute[76161]: INFO nova.virt.block_device [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Booting with volume a71fb36d-a619-4319-b204-7ff8e4e5bbed at /dev/vda
Nov 14 18:16:22 user nova-compute[76161]: DEBUG os_brick.utils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ac296e-8a0a-4a99-99b8-20fe902ce517]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[16128ade-eaf4-47be-974d-aaeeeb01a838]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[599e4b52-d0fc-4d62-8c55-36016d55af58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f00c303-cb95-48f0-94a7-79625765d09b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:16:22 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:16:22 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b2b2b7-e621-4820-875e-9f1093fd6152]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG os_brick.utils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Updating existing volume attachment record: 1416eb1a-5e6d-4a53-a393-12c8676b3cd7 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:16:22 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Successfully created port: ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Successfully updated port: ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquired lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-ea3de3ea-399e-4fa1-b656-3d5bce02863d req-16619a0d-85a4-4046-a7d4-51b402e8dbda service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received event network-changed-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG nova.compute.manager [req-ea3de3ea-399e-4fa1-b656-3d5bce02863d req-16619a0d-85a4-4046-a7d4-51b402e8dbda service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Refreshing instance network info cache due to event network-changed-ed0e525d-f08e-4ba0-b60c-70d979928715. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ea3de3ea-399e-4fa1-b656-3d5bce02863d req-16619a0d-85a4-4046-a7d4-51b402e8dbda service nova] Acquiring lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVlPjMDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:16:23 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:16:23 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:16:23 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d0493-eccc-4025-a8ac-b83a090e6df1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:16:23 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f028b46b-673b-47e6-8ac6-026021208392]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8] added
Nov 14 18:16:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9d470e-6c7b-4525-9166-6ff89fa8bce7]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[888edd02-c717-4c35-aca5-2355b8f1caa9]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVlPjMDW {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVlPjMDW" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b48f44a-c3f8-44f4-bdd3-9d2a0048cbcc]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gVlPjMDW'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0152d4-ad83-4090-9757-b8d4a8811fa9]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43604d-c650-481f-be24-6c19c133cb62]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a0cc32-35e6-4615-bd27-560ceb0c25a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260]
Nov 14 18:16:23 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260] successful.
Nov 14 18:16:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Updating instance_info_cache with network_info: [{"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f00d393-267d-4678-9c84-5b3f8878aaa7]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Releasing lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Instance network_info: |[{"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ea3de3ea-399e-4fa1-b656-3d5bce02863d req-16619a0d-85a4-4046-a7d4-51b402e8dbda service nova] Acquired lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG nova.network.neutron [req-ea3de3ea-399e-4fa1-b656-3d5bce02863d req-16619a0d-85a4-4046-a7d4-51b402e8dbda service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Refreshing network info cache for port ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab130b95-aa90-4684-bebd-d4f1c5cc5f18]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:23 user nova-compute[76161]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:16:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:23 user nova-compute[76161]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:16:23 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab838806-77b7-4831-bb00-212dff94bef4]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:16:23 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVlPjMDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:16:24 user nova-compute[76161]: DEBUG nova.network.neutron [req-ea3de3ea-399e-4fa1-b656-3d5bce02863d req-16619a0d-85a4-4046-a7d4-51b402e8dbda service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Updated VIF entry in instance network info cache for port ed0e525d-f08e-4ba0-b60c-70d979928715. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:16:24 user nova-compute[76161]: DEBUG nova.network.neutron [req-ea3de3ea-399e-4fa1-b656-3d5bce02863d req-16619a0d-85a4-4046-a7d4-51b402e8dbda service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Updating instance_info_cache with network_info: [{"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:16:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ea3de3ea-399e-4fa1-b656-3d5bce02863d req-16619a0d-85a4-4046-a7d4-51b402e8dbda service nova] Releasing lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:16:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:16:24 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23863333238633831', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:16:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863333238633831', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:16:24 user nova-compute[76161]: DEBUG nova.objects.instance [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'flavor' on Instance uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:16:24 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:16:24 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:16:24 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:16:24 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:16:24 user nova-compute[76161]:   <serial>98a7a461-4fa9-40dc-ab86-1196caf1efe8</serial>
Nov 14 18:16:24 user nova-compute[76161]: </disk>
Nov 14 18:16:24 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:16:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:16:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:16:25 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] No VIF found with MAC fa:16:3e:7a:38:21, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:16:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-24955197-f0bf-4f0f-b286-b6ef2e56493e tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.365s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:16:26 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Creating image(s)
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Did not create local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Ensure instance console log exists: /opt/stack/data/nova/instances/ee2ce386-76c6-49f8-bc69-453ecdf8eafb/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Start _get_guest_xml network_info=[{"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rewvlVCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee2ce386-76c6-49f8-bc69-453ecdf8eafb', 'attached_at': '', 'detached_at': '', 'volume_id': 'a71fb36d-a619-4319-b204-7ff8e4e5bbed', 'serial': 'a71fb36d-a619-4319-b204-7ff8e4e5bbed'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '1416eb1a-5e6d-4a53-a393-12c8676b3cd7', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:16:26 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:16:26 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rewvlVCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:16:26 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:16:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:16:26 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:16:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:16:26 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:16:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1033664b-d884-4365-bff4-0ed42fc114ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:16:26 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55f184c-86bc-45b2-9f32-2338cec8819a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed] added
Nov 14 18:16:26 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:26 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c004449d-a854-4d5e-aec4-fb0b9f9c476f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f14172c-ce8d-49a7-9fca-09019a50e199]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rewvlVCQ {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rewvlVCQ" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4cf987-43c5-4058-8037-f5ac91e94ebd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rewvlVCQ'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c00a06e-af72-4e43-a3e6-55f2a94268cf]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7645aeda-28bf-4d6b-a932-cac8c04336d7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:27 user nova-compute[76161]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:16:27 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:27 user nova-compute[76161]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:16:27 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[065027d4-47f7-4f20-8aeb-5140b97e7392]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed, portal: 172.16.0.220,3260]
Nov 14 18:16:27 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed, portal: 172.16.0.220,3260] successful.
Nov 14 18:16:27 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0ff796-8a07-42ad-9d48-95ec65bfb083]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f112c58-33c5-4d34-b7e9-6d0f9b3c7760]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:27 user nova-compute[76161]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:16:27 user nova-compute[76161]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)
Nov 14 18:16:27 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:27 user nova-compute[76161]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:16:27 user nova-compute[76161]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)
Nov 14 18:16:27 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:27 user nova-compute[76161]: INFO nova.compute.manager [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Terminating instance
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG nova.compute.manager [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac19dbf-21a0-414b-afc9-7f3fb0b02844]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rewvlVCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-4c9fe234-beb4-4b0c-879f-33589a94b0eb req-71603623-0a84-4e2e-9cbc-de0b0db0765e service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-unplugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4c9fe234-beb4-4b0c-879f-33589a94b0eb req-71603623-0a84-4e2e-9cbc-de0b0db0765e service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4c9fe234-beb4-4b0c-879f-33589a94b0eb req-71603623-0a84-4e2e-9cbc-de0b0db0765e service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-4c9fe234-beb4-4b0c-879f-33589a94b0eb req-71603623-0a84-4e2e-9cbc-de0b0db0765e service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-4c9fe234-beb4-4b0c-879f-33589a94b0eb req-71603623-0a84-4e2e-9cbc-de0b0db0765e service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-unplugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:27 user nova-compute[76161]: DEBUG nova.compute.manager [req-4c9fe234-beb4-4b0c-879f-33589a94b0eb req-71603623-0a84-4e2e-9cbc-de0b0db0765e service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-unplugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:16:28 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Instance destroyed successfully.
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.objects.instance [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lazy-loading 'resources' on Instance uuid 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-196351056',display_name='tempest-ServerStableDeviceRescueTest-server-196351056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-196351056',id=44,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77XaCIngo1th53padje9DsAhl9KOSKNZfZjKECok4W8bntCT4mMyM8EyF0mqq2RPfflzegwryBnKJf/5p1N/fK3vrUfhE2263FFBur2SdR/bJMZXl3/2cEbUtkm0HM/A==',key_name='tempest-keypair-1640878755',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd8a6f01a49a45df9ce7c8bb72fe09aa',ramdisk_id='',reservation_id='r-9p4i9zht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-888944149',owner_user_name='tempest-ServerStableDeviceRescueTest-888944149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b58cf52433541ff9230d5d7a5944c40',uuid=3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Converting VIF {"id": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "address": "fa:16:3e:42:c6:04", "network": {"id": "3e50900b-d50a-4af2-9e2a-b4be58b96dd3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-479311813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd8a6f01a49a45df9ce7c8bb72fe09aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99e841f1-c4", "ovs_interfaceid": "99e841f1-c43d-40dc-9376-8f64d20e4f15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:c6:04,bridge_name='br-int',has_traffic_filtering=True,id=99e841f1-c43d-40dc-9376-8f64d20e4f15,network=Network(3e50900b-d50a-4af2-9e2a-b4be58b96dd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99e841f1-c4') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG os_vif [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:c6:04,bridge_name='br-int',has_traffic_filtering=True,id=99e841f1-c43d-40dc-9376-8f64d20e4f15,network=Network(3e50900b-d50a-4af2-9e2a-b4be58b96dd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99e841f1-c4') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99e841f1-c4, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f056002-3c74-43dd-844d-ed64f2788cd6) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: INFO os_vif [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:c6:04,bridge_name='br-int',has_traffic_filtering=True,id=99e841f1-c43d-40dc-9376-8f64d20e4f15,network=Network(3e50900b-d50a-4af2-9e2a-b4be58b96dd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99e841f1-c4')
Nov 14 18:16:28 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Deleting instance files /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98_del
Nov 14 18:16:28 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Deletion of /opt/stack/data/nova/instances/3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98_del complete
Nov 14 18:16:28 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Skipping network cache update for instance because it is being deleted. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 14 18:16:28 user nova-compute[76161]: INFO nova.compute.manager [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 18:16:28 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23766643530376630', 'path': '/dev/sdd'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766643530376630', 'path': '/dev/sdd'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1350613177',display_name='tempest-TestVolumeBootPattern-server-1350613177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1350613177',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHVYDN2Xftf5V1grXUvkOAuZ4lRy2Yu8x71x7XZMVIMR4I5qKGZtkFKrVxApclfxwZHmCeNjcLNUIFGzVbzrwECoYdV2hlra8hiYCIDqSv04geiOynO7IsegUM2gQdCg==',key_name='tempest-TestVolumeBootPattern-706510423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-547t6xo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:16:22Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=ee2ce386-76c6-49f8-bc69-453ecdf8eafb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:17,bridge_name='br-int',has_traffic_filtering=True,id=ed0e525d-f08e-4ba0-b60c-70d979928715,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0e525d-f0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'pci_devices' on Instance uuid ee2ce386-76c6-49f8-bc69-453ecdf8eafb {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:16:28 user nova-compute[76161]:   <uuid>ee2ce386-76c6-49f8-bc69-453ecdf8eafb</uuid>
Nov 14 18:16:28 user nova-compute[76161]:   <name>instance-00000033</name>
Nov 14 18:16:28 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:16:28 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:16:28 user nova-compute[76161]:   <metadata>
Nov 14 18:16:28 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:16:28 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:16:28 user nova-compute[76161]:       <nova:name>tempest-TestVolumeBootPattern-server-1350613177</nova:name>
Nov 14 18:16:28 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:16:26</nova:creationTime>
Nov 14 18:16:28 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:16:28 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:16:28 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:16:28 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:16:28 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:16:28 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:16:28 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:16:28 user nova-compute[76161]:       <nova:owner>
Nov 14 18:16:28 user nova-compute[76161]:         <nova:user uuid="d22a86988e6043d2ab950e0d6e557ef8">tempest-TestVolumeBootPattern-1727647616-project-member</nova:user>
Nov 14 18:16:28 user nova-compute[76161]:         <nova:project uuid="81682e21827c4572b1659004cc22215a">tempest-TestVolumeBootPattern-1727647616</nova:project>
Nov 14 18:16:28 user nova-compute[76161]:       </nova:owner>
Nov 14 18:16:28 user nova-compute[76161]:       <nova:ports>
Nov 14 18:16:28 user nova-compute[76161]:         <nova:port uuid="ed0e525d-f08e-4ba0-b60c-70d979928715">
Nov 14 18:16:28 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 18:16:28 user nova-compute[76161]:         </nova:port>
Nov 14 18:16:28 user nova-compute[76161]:       </nova:ports>
Nov 14 18:16:28 user nova-compute[76161]:     </nova:instance>
Nov 14 18:16:28 user nova-compute[76161]:   </metadata>
Nov 14 18:16:28 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:16:28 user nova-compute[76161]:     <system>
Nov 14 18:16:28 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:16:28 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:16:28 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:16:28 user nova-compute[76161]:       <entry name="serial">ee2ce386-76c6-49f8-bc69-453ecdf8eafb</entry>
Nov 14 18:16:28 user nova-compute[76161]:       <entry name="uuid">ee2ce386-76c6-49f8-bc69-453ecdf8eafb</entry>
Nov 14 18:16:28 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:16:28 user nova-compute[76161]:     </system>
Nov 14 18:16:28 user nova-compute[76161]:   </sysinfo>
Nov 14 18:16:28 user nova-compute[76161]:   <os>
Nov 14 18:16:28 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:16:28 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:16:28 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:16:28 user nova-compute[76161]:   </os>
Nov 14 18:16:28 user nova-compute[76161]:   <features>
Nov 14 18:16:28 user nova-compute[76161]:     <acpi/>
Nov 14 18:16:28 user nova-compute[76161]:     <apic/>
Nov 14 18:16:28 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:16:28 user nova-compute[76161]:   </features>
Nov 14 18:16:28 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:16:28 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:16:28 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:16:28 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:16:28 user nova-compute[76161]:   </clock>
Nov 14 18:16:28 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:16:28 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:16:28 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:16:28 user nova-compute[76161]:   </cpu>
Nov 14 18:16:28 user nova-compute[76161]:   <devices>
Nov 14 18:16:28 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:16:28 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:16:28 user nova-compute[76161]:       <source dev="/dev/sdd"/>
Nov 14 18:16:28 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:16:28 user nova-compute[76161]:       <serial>a71fb36d-a619-4319-b204-7ff8e4e5bbed</serial>
Nov 14 18:16:28 user nova-compute[76161]:     </disk>
Nov 14 18:16:28 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:16:28 user nova-compute[76161]:       <mac address="fa:16:3e:f0:6e:17"/>
Nov 14 18:16:28 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:16:28 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:16:28 user nova-compute[76161]:       <target dev="taped0e525d-f0"/>
Nov 14 18:16:28 user nova-compute[76161]:     </interface>
Nov 14 18:16:28 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:16:28 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/ee2ce386-76c6-49f8-bc69-453ecdf8eafb/console.log" append="off"/>
Nov 14 18:16:28 user nova-compute[76161]:     </serial>
Nov 14 18:16:28 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:16:28 user nova-compute[76161]:     <video>
Nov 14 18:16:28 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:16:28 user nova-compute[76161]:     </video>
Nov 14 18:16:28 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:16:28 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:16:28 user nova-compute[76161]:     </rng>
Nov 14 18:16:28 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:16:28 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:16:28 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:16:28 user nova-compute[76161]:     </memballoon>
Nov 14 18:16:28 user nova-compute[76161]:   </devices>
Nov 14 18:16:28 user nova-compute[76161]: </domain>
Nov 14 18:16:28 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1350613177',display_name='tempest-TestVolumeBootPattern-server-1350613177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1350613177',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHVYDN2Xftf5V1grXUvkOAuZ4lRy2Yu8x71x7XZMVIMR4I5qKGZtkFKrVxApclfxwZHmCeNjcLNUIFGzVbzrwECoYdV2hlra8hiYCIDqSv04geiOynO7IsegUM2gQdCg==',key_name='tempest-TestVolumeBootPattern-706510423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-547t6xo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:16:22Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=ee2ce386-76c6-49f8-bc69-453ecdf8eafb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:17,bridge_name='br-int',has_traffic_filtering=True,id=ed0e525d-f08e-4ba0-b60c-70d979928715,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0e525d-f0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG os_vif [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:17,bridge_name='br-int',has_traffic_filtering=True,id=ed0e525d-f08e-4ba0-b60c-70d979928715,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0e525d-f0') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57759b63-f4d1-56a9-b951-5567f7a8daa1', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped0e525d-f0, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped0e525d-f0, col_values=(('qos', UUID('72545baf-9733-4e6f-971d-e5e59d485e8e')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped0e525d-f0, col_values=(('external_ids', {'iface-id': 'ed0e525d-f08e-4ba0-b60c-70d979928715', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:6e:17', 'vm-uuid': 'ee2ce386-76c6-49f8-bc69-453ecdf8eafb'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:28 user nova-compute[76161]: INFO os_vif [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:6e:17,bridge_name='br-int',has_traffic_filtering=True,id=ed0e525d-f08e-4ba0-b60c-70d979928715,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0e525d-f0')
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] No VIF found with MAC fa:16:3e:f0:6e:17, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-405575e2-0ca4-4c5b-a4b5-c1abb4e62f89 req-149dbdb4-9ba1-4d66-bb8c-ec103b3f6023 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-changed-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.compute.manager [req-405575e2-0ca4-4c5b-a4b5-c1abb4e62f89 req-149dbdb4-9ba1-4d66-bb8c-ec103b3f6023 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Refreshing instance network info cache due to event network-changed-85a65a97-cac5-41c2-9943-4cbc64cb9c21. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-405575e2-0ca4-4c5b-a4b5-c1abb4e62f89 req-149dbdb4-9ba1-4d66-bb8c-ec103b3f6023 service nova] Acquiring lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-405575e2-0ca4-4c5b-a4b5-c1abb4e62f89 req-149dbdb4-9ba1-4d66-bb8c-ec103b3f6023 service nova] Acquired lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.network.neutron [req-405575e2-0ca4-4c5b-a4b5-c1abb4e62f89 req-149dbdb4-9ba1-4d66-bb8c-ec103b3f6023 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Refreshing network info cache for port 85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Updating instance_info_cache with network_info: [{"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:16:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG nova.network.neutron [req-405575e2-0ca4-4c5b-a4b5-c1abb4e62f89 req-149dbdb4-9ba1-4d66-bb8c-ec103b3f6023 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updated VIF entry in instance network info cache for port 85a65a97-cac5-41c2-9943-4cbc64cb9c21. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG nova.network.neutron [req-405575e2-0ca4-4c5b-a4b5-c1abb4e62f89 req-149dbdb4-9ba1-4d66-bb8c-ec103b3f6023 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updating instance_info_cache with network_info: [{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:16:29 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Took 1.05 seconds to deallocate network for instance.
Nov 14 18:16:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-405575e2-0ca4-4c5b-a4b5-c1abb4e62f89 req-149dbdb4-9ba1-4d66-bb8c-ec103b3f6023 service nova] Releasing lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-d9759471-77c5-47f5-afc7-8da1349c2362 req-71a17119-c5c8-4228-a0da-4bfb2dbfdf0c service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-deleted-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-ca9d548d-fbf4-4b3f-9a3b-cd687102898c req-98b9551d-fdd6-4829-9ad7-14ad570f4525 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ca9d548d-fbf4-4b3f-9a3b-cd687102898c req-98b9551d-fdd6-4829-9ad7-14ad570f4525 service nova] Acquiring lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ca9d548d-fbf4-4b3f-9a3b-cd687102898c req-98b9551d-fdd6-4829-9ad7-14ad570f4525 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ca9d548d-fbf4-4b3f-9a3b-cd687102898c req-98b9551d-fdd6-4829-9ad7-14ad570f4525 service nova] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG nova.compute.manager [req-ca9d548d-fbf4-4b3f-9a3b-cd687102898c req-98b9551d-fdd6-4829-9ad7-14ad570f4525 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] No waiting events found dispatching network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:29 user nova-compute[76161]: WARNING nova.compute.manager [req-ca9d548d-fbf4-4b3f-9a3b-cd687102898c req-98b9551d-fdd6-4829-9ad7-14ad570f4525 service nova] [instance: 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98] Received unexpected event network-vif-plugged-99e841f1-c43d-40dc-9376-8f64d20e4f15 for instance with vm_state deleted and task_state None.
Nov 14 18:16:29 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Deleted allocations for instance 3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98
Nov 14 18:16:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-92f22077-3c89-4c00-aaab-9290e5f156d4 tempest-ServerStableDeviceRescueTest-888944149 tempest-ServerStableDeviceRescueTest-888944149-project-member] Lock "3c3a6f2c-7c9d-4724-8f95-ca7eda5b8e98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.440s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-67b6182d-85ea-426c-8f5f-8755239767db req-f445096c-9761-4a5d-b87c-721c4bfde7a7 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-changed-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-67b6182d-85ea-426c-8f5f-8755239767db req-f445096c-9761-4a5d-b87c-721c4bfde7a7 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Refreshing instance network info cache due to event network-changed-85a65a97-cac5-41c2-9943-4cbc64cb9c21. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-67b6182d-85ea-426c-8f5f-8755239767db req-f445096c-9761-4a5d-b87c-721c4bfde7a7 service nova] Acquiring lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-67b6182d-85ea-426c-8f5f-8755239767db req-f445096c-9761-4a5d-b87c-721c4bfde7a7 service nova] Acquired lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.network.neutron [req-67b6182d-85ea-426c-8f5f-8755239767db req-f445096c-9761-4a5d-b87c-721c4bfde7a7 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Refreshing network info cache for port 85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received event network-vif-plugged-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] Acquiring lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] No waiting events found dispatching network-vif-plugged-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:31 user nova-compute[76161]: WARNING nova.compute.manager [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received unexpected event network-vif-plugged-ed0e525d-f08e-4ba0-b60c-70d979928715 for instance with vm_state building and task_state spawning.
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received event network-vif-plugged-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] Acquiring lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.compute.manager [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] No waiting events found dispatching network-vif-plugged-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:31 user nova-compute[76161]: WARNING nova.compute.manager [req-7a942296-6bb9-458c-9efe-20713779f304 req-d39c7441-36d4-4717-b64d-0c95cd07308e service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received unexpected event network-vif-plugged-ed0e525d-f08e-4ba0-b60c-70d979928715 for instance with vm_state building and task_state spawning.
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.network.neutron [req-67b6182d-85ea-426c-8f5f-8755239767db req-f445096c-9761-4a5d-b87c-721c4bfde7a7 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updated VIF entry in instance network info cache for port 85a65a97-cac5-41c2-9943-4cbc64cb9c21. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.network.neutron [req-67b6182d-85ea-426c-8f5f-8755239767db req-f445096c-9761-4a5d-b87c-721c4bfde7a7 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updating instance_info_cache with network_info: [{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-67b6182d-85ea-426c-8f5f-8755239767db req-f445096c-9761-4a5d-b87c-721c4bfde7a7 service nova] Releasing lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:16:31 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Instance spawned successfully.
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:16:31 user nova-compute[76161]: INFO nova.compute.manager [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 14 18:16:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:16:31 user nova-compute[76161]: INFO nova.compute.manager [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Took 10.28 seconds to build instance.
Nov 14 18:16:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c7993b5c-9687-4f8c-88be-de23f997cfcc tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.370s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:16:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:16:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:33 user nova-compute[76161]: INFO nova.compute.manager [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Rebooting instance
Nov 14 18:16:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquired lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG nova.network.neutron [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updating instance_info_cache with network_info: [{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Releasing lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-6b68aa86-ad18-4337-8a39-4c09d2a4e932 req-c109f258-48e5-42a7-a572-f2a6e94f1962 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-vif-unplugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b68aa86-ad18-4337-8a39-4c09d2a4e932 req-c109f258-48e5-42a7-a572-f2a6e94f1962 service nova] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b68aa86-ad18-4337-8a39-4c09d2a4e932 req-c109f258-48e5-42a7-a572-f2a6e94f1962 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-6b68aa86-ad18-4337-8a39-4c09d2a4e932 req-c109f258-48e5-42a7-a572-f2a6e94f1962 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG nova.compute.manager [req-6b68aa86-ad18-4337-8a39-4c09d2a4e932 req-c109f258-48e5-42a7-a572-f2a6e94f1962 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] No waiting events found dispatching network-vif-unplugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:34 user nova-compute[76161]: WARNING nova.compute.manager [req-6b68aa86-ad18-4337-8a39-4c09d2a4e932 req-c109f258-48e5-42a7-a572-f2a6e94f1962 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received unexpected event network-vif-unplugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:16:34 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Instance destroyed successfully.
Nov 14 18:16:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'resources' on Instance uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1070282106',display_name='tempest-TestMinimumBasicScenario-server-1070282106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1070282106',id=49,image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjEeSYdg8v8pt4SmYmzNQO5ZL1McegI+xu8cN/VHJTsi7Bn6WW6HjSG4OAYHkziGNE2clc6cJDmcYgvtcc5fazdsZIGzLsPjKOgooFUT+gajlYmF81p6ViKBNYNiRyEJA==',key_name='tempest-TestMinimumBasicScenario-1264911207',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83e313849c0b452e9dd6f5afd4006e31',ramdisk_id='',reservation_id='r-wpw69b78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-451246924',owner_user_name='tempest-TestMinimumBasicScenario-451246924-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:16:34Z,user_data=None,user_id='fcb6dc8c680145809756f79ccc78ead8',uuid=b768391e-9952-4c91-a336-59ac7127b8ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converting VIF {"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_vif [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85a65a97-ca, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2822e1b-89fa-43fb-a25c-e1e1f45c42c8) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:34 user nova-compute[76161]: INFO os_vif [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca')
Nov 14 18:16:34 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVlPjMDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:16:34 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f573618-c773-4396-870d-05a9d75497f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:16:34 user nova-compute[76161]: No targets found.
Nov 14 18:16:34 user nova-compute[76161]: iSNS:
Nov 14 18:16:34 user nova-compute[76161]: No targets found.
Nov 14 18:16:34 user nova-compute[76161]: STATIC:
Nov 14 18:16:34 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e
Nov 14 18:16:34 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:16:34 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:16:34 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed
Nov 14 18:16:34 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:16:34 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:16:34 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8
Nov 14 18:16:34 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:16:34 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:16:34 user nova-compute[76161]: FIRMWARE:
Nov 14 18:16:34 user nova-compute[76161]: No targets found.
Nov 14 18:16:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:16:34 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:16:34 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b4cf2f-b890-41b2-89a5-79a8bf8142a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d82c4a8-a145-4211-88b8-20cc71583de6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:34 user nova-compute[76161]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:16:34 user nova-compute[76161]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)
Nov 14 18:16:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:34 user nova-compute[76161]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:16:34 user nova-compute[76161]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)
Nov 14 18:16:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f06e2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[168a38b3-a4d8-438e-a70e-ea32559746a2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5297923f-f8d8-42ea-af26-7571e05d1eb2]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbe856e-028d-408f-90f3-ef2f5245aaa5]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[51363fbe-4454-473d-9b44-8f90c524f1fe]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[896fbb2b-57c4-4865-9317-ee81db671bcd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32b8f1e-1f24-4d4f-881f-3b6f6c8d9b6c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260]
Nov 14 18:16:34 user nova-compute[76161]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260] successful.
Nov 14 18:16:34 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:34 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac047eac-c44c-42a4-b782-0211a97104ac]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] <== disconnect_volume: return (314ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Start _get_guest_xml network_info=[{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7640a2d0-54ea-4669-a8db-a1f48011dda6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '7640a2d0-54ea-4669-a8db-a1f48011dda6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVlPjMDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b768391e-9952-4c91-a336-59ac7127b8ca', 'attached_at': '', 'detached_at': '', 'volume_id': '98a7a461-4fa9-40dc-ab86-1196caf1efe8', 'serial': '98a7a461-4fa9-40dc-ab86-1196caf1efe8'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '8ed1556e-16e2-4da4-9199-0be8c4b7d5c6', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:16:35 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:16:35 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7640a2d0-54ea-4669-a8db-a1f48011dda6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'vcpu_model' on Instance uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.objects.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Object Instance<b768391e-9952-4c91-a336-59ac7127b8ca> lazy-loaded attributes: resources,vcpu_model {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVlPjMDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:16:35 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:16:35 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:16:35 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[497152e3-60e3-407b-8b8a-7486f872e486]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:16:35 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cd751b-dc6b-49e0-ad1a-b218826f87b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8] added
Nov 14 18:16:35 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeb50e8-129b-4370-ab80-6b289cc08e34]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7638c474-9e40-421d-9259-889bea14afd3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVlPjMDW {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVlPjMDW" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57ed214-48bd-412e-b66b-e8e54c8a2b96]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gVlPjMDW'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ada7590-57ba-426c-9cb5-d82096df0f34]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a2c2ab-6218-4c37-8b2d-9e069a2ced3e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:35 user nova-compute[76161]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)
Nov 14 18:16:35 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:35 user nova-compute[76161]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)
Nov 14 18:16:35 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ad856e-95bc-4a40-9d01-104be167fe96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260]
Nov 14 18:16:35 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260] successful.
Nov 14 18:16:35 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb67bd58-245d-4e5a-9eb6-8a8839201d1e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca44e255-65df-45fc-a08b-0955063f2e69]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:35 user nova-compute[76161]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)
Nov 14 18:16:35 user nova-compute[76161]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:16:35 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:16:35 user nova-compute[76161]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)
Nov 14 18:16:35 user nova-compute[76161]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:16:35 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac8733-8ce1-47cb-b7f6-9b7258db66d1]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:16:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.compute.manager [req-43ffa61d-bdca-4c4b-9809-ac13a120acf9 req-f30fb8d9-09ff-4148-ad6e-636eb53c716e service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-43ffa61d-bdca-4c4b-9809-ac13a120acf9 req-f30fb8d9-09ff-4148-ad6e-636eb53c716e service nova] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-43ffa61d-bdca-4c4b-9809-ac13a120acf9 req-f30fb8d9-09ff-4148-ad6e-636eb53c716e service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-43ffa61d-bdca-4c4b-9809-ac13a120acf9 req-f30fb8d9-09ff-4148-ad6e-636eb53c716e service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.compute.manager [req-43ffa61d-bdca-4c4b-9809-ac13a120acf9 req-f30fb8d9-09ff-4148-ad6e-636eb53c716e service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] No waiting events found dispatching network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:36 user nova-compute[76161]: WARNING nova.compute.manager [req-43ffa61d-bdca-4c4b-9809-ac13a120acf9 req-f30fb8d9-09ff-4148-ad6e-636eb53c716e service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received unexpected event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 18:16:36 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVlPjMDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23863333238633831', 'path': '/dev/sdc'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863333238633831', 'path': '/dev/sdc'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1070282106',display_name='tempest-TestMinimumBasicScenario-server-1070282106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1070282106',id=49,image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjEeSYdg8v8pt4SmYmzNQO5ZL1McegI+xu8cN/VHJTsi7Bn6WW6HjSG4OAYHkziGNE2clc6cJDmcYgvtcc5fazdsZIGzLsPjKOgooFUT+gajlYmF81p6ViKBNYNiRyEJA==',key_name='tempest-TestMinimumBasicScenario-1264911207',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83e313849c0b452e9dd6f5afd4006e31',ramdisk_id='',reservation_id='r-wpw69b78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-451246924',owner_user_name='tempest-TestMinimumBasicScenario-451246924-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:16:34Z,user_data=None,user_id='fcb6dc8c680145809756f79ccc78ead8',uuid=b768391e-9952-4c91-a336-59ac7127b8ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converting VIF {"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'pci_devices' on Instance uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.objects.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Object Instance<b768391e-9952-4c91-a336-59ac7127b8ca> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:16:36 user nova-compute[76161]:   <uuid>b768391e-9952-4c91-a336-59ac7127b8ca</uuid>
Nov 14 18:16:36 user nova-compute[76161]:   <name>instance-00000031</name>
Nov 14 18:16:36 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:16:36 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:16:36 user nova-compute[76161]:   <metadata>
Nov 14 18:16:36 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:16:36 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:16:36 user nova-compute[76161]:       <nova:name>tempest-TestMinimumBasicScenario-server-1070282106</nova:name>
Nov 14 18:16:36 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:16:35</nova:creationTime>
Nov 14 18:16:36 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:16:36 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:16:36 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:16:36 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:16:36 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:16:36 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:16:36 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:16:36 user nova-compute[76161]:       <nova:owner>
Nov 14 18:16:36 user nova-compute[76161]:         <nova:user uuid="fcb6dc8c680145809756f79ccc78ead8">tempest-TestMinimumBasicScenario-451246924-project-member</nova:user>
Nov 14 18:16:36 user nova-compute[76161]:         <nova:project uuid="83e313849c0b452e9dd6f5afd4006e31">tempest-TestMinimumBasicScenario-451246924</nova:project>
Nov 14 18:16:36 user nova-compute[76161]:       </nova:owner>
Nov 14 18:16:36 user nova-compute[76161]:       <nova:root type="image" uuid="7640a2d0-54ea-4669-a8db-a1f48011dda6"/>
Nov 14 18:16:36 user nova-compute[76161]:       <nova:ports>
Nov 14 18:16:36 user nova-compute[76161]:         <nova:port uuid="85a65a97-cac5-41c2-9943-4cbc64cb9c21">
Nov 14 18:16:36 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 18:16:36 user nova-compute[76161]:         </nova:port>
Nov 14 18:16:36 user nova-compute[76161]:       </nova:ports>
Nov 14 18:16:36 user nova-compute[76161]:     </nova:instance>
Nov 14 18:16:36 user nova-compute[76161]:   </metadata>
Nov 14 18:16:36 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:16:36 user nova-compute[76161]:     <system>
Nov 14 18:16:36 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:16:36 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:16:36 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:16:36 user nova-compute[76161]:       <entry name="serial">b768391e-9952-4c91-a336-59ac7127b8ca</entry>
Nov 14 18:16:36 user nova-compute[76161]:       <entry name="uuid">b768391e-9952-4c91-a336-59ac7127b8ca</entry>
Nov 14 18:16:36 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:16:36 user nova-compute[76161]:     </system>
Nov 14 18:16:36 user nova-compute[76161]:   </sysinfo>
Nov 14 18:16:36 user nova-compute[76161]:   <os>
Nov 14 18:16:36 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:16:36 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:16:36 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:16:36 user nova-compute[76161]:   </os>
Nov 14 18:16:36 user nova-compute[76161]:   <features>
Nov 14 18:16:36 user nova-compute[76161]:     <acpi/>
Nov 14 18:16:36 user nova-compute[76161]:     <apic/>
Nov 14 18:16:36 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:16:36 user nova-compute[76161]:   </features>
Nov 14 18:16:36 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:16:36 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:16:36 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:16:36 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:16:36 user nova-compute[76161]:   </clock>
Nov 14 18:16:36 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:16:36 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:16:36 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:16:36 user nova-compute[76161]:   </cpu>
Nov 14 18:16:36 user nova-compute[76161]:   <devices>
Nov 14 18:16:36 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:16:36 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:16:36 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk"/>
Nov 14 18:16:36 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:16:36 user nova-compute[76161]:     </disk>
Nov 14 18:16:36 user nova-compute[76161]:     <disk type="block" device="disk">
Nov 14 18:16:36 user nova-compute[76161]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:16:36 user nova-compute[76161]:       <source dev="/dev/sdc"/>
Nov 14 18:16:36 user nova-compute[76161]:       <target dev="vdb" bus="virtio"/>
Nov 14 18:16:36 user nova-compute[76161]:       <serial>98a7a461-4fa9-40dc-ab86-1196caf1efe8</serial>
Nov 14 18:16:36 user nova-compute[76161]:     </disk>
Nov 14 18:16:36 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:16:36 user nova-compute[76161]:       <mac address="fa:16:3e:7a:38:21"/>
Nov 14 18:16:36 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:16:36 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:16:36 user nova-compute[76161]:       <target dev="tap85a65a97-ca"/>
Nov 14 18:16:36 user nova-compute[76161]:     </interface>
Nov 14 18:16:36 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:16:36 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/console.log" append="off"/>
Nov 14 18:16:36 user nova-compute[76161]:     </serial>
Nov 14 18:16:36 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:16:36 user nova-compute[76161]:     <video>
Nov 14 18:16:36 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:16:36 user nova-compute[76161]:     </video>
Nov 14 18:16:36 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:16:36 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:16:36 user nova-compute[76161]:     </rng>
Nov 14 18:16:36 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:16:36 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:16:36 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:16:36 user nova-compute[76161]:     </memballoon>
Nov 14 18:16:36 user nova-compute[76161]:   </devices>
Nov 14 18:16:36 user nova-compute[76161]: </domain>
Nov 14 18:16:36 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'trusted_certs' on Instance uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG nova.objects.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Object Instance<b768391e-9952-4c91-a336-59ac7127b8ca> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:16:36 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671 --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Cannot resize image /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'migration_context' on Instance uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG nova.objects.base [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Object Instance<b768391e-9952-4c91-a336-59ac7127b8ca> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76161) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1070282106',display_name='tempest-TestMinimumBasicScenario-server-1070282106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1070282106',id=49,image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjEeSYdg8v8pt4SmYmzNQO5ZL1McegI+xu8cN/VHJTsi7Bn6WW6HjSG4OAYHkziGNE2clc6cJDmcYgvtcc5fazdsZIGzLsPjKOgooFUT+gajlYmF81p6ViKBNYNiRyEJA==',key_name='tempest-TestMinimumBasicScenario-1264911207',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='83e313849c0b452e9dd6f5afd4006e31',ramdisk_id='',reservation_id='r-wpw69b78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-451246924',owner_user_name='tempest-TestMinimumBasicScenario-451246924-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:16:34Z,user_data=None,user_id='fcb6dc8c680145809756f79ccc78ead8',uuid=b768391e-9952-4c91-a336-59ac7127b8ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converting VIF {"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG os_vif [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba4b72b7-5102-5e5d-b57a-02966bf947a4', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85a65a97-ca, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85a65a97-ca, col_values=(('qos', UUID('3f0057e1-cc2f-4a4c-8cca-94404d59b9d8')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85a65a97-ca, col_values=(('external_ids', {'iface-id': '85a65a97-cac5-41c2-9943-4cbc64cb9c21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:38:21', 'vm-uuid': 'b768391e-9952-4c91-a336-59ac7127b8ca'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:37 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:37 user nova-compute[76161]: INFO os_vif [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca')
Nov 14 18:16:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-b5a067a6-0a4e-4a0e-88e9-40b006386e46 req-f0a26df6-64da-4845-b59c-114a7b647322 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b5a067a6-0a4e-4a0e-88e9-40b006386e46 req-f0a26df6-64da-4845-b59c-114a7b647322 service nova] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b5a067a6-0a4e-4a0e-88e9-40b006386e46 req-f0a26df6-64da-4845-b59c-114a7b647322 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:38 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b5a067a6-0a4e-4a0e-88e9-40b006386e46 req-f0a26df6-64da-4845-b59c-114a7b647322 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:38 user nova-compute[76161]: DEBUG nova.compute.manager [req-b5a067a6-0a4e-4a0e-88e9-40b006386e46 req-f0a26df6-64da-4845-b59c-114a7b647322 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] No waiting events found dispatching network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:38 user nova-compute[76161]: WARNING nova.compute.manager [req-b5a067a6-0a4e-4a0e-88e9-40b006386e46 req-f0a26df6-64da-4845-b59c-114a7b647322 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received unexpected event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:39 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-5722731b-a795-4c12-999f-1df1ddbb577d req-6a9e25ec-5cfd-4f35-a97b-bb83acb31f11 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5722731b-a795-4c12-999f-1df1ddbb577d req-6a9e25ec-5cfd-4f35-a97b-bb83acb31f11 service nova] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5722731b-a795-4c12-999f-1df1ddbb577d req-6a9e25ec-5cfd-4f35-a97b-bb83acb31f11 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5722731b-a795-4c12-999f-1df1ddbb577d req-6a9e25ec-5cfd-4f35-a97b-bb83acb31f11 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG nova.compute.manager [req-5722731b-a795-4c12-999f-1df1ddbb577d req-6a9e25ec-5cfd-4f35-a97b-bb83acb31f11 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] No waiting events found dispatching network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:40 user nova-compute[76161]: WARNING nova.compute.manager [req-5722731b-a795-4c12-999f-1df1ddbb577d req-6a9e25ec-5cfd-4f35-a97b-bb83acb31f11 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received unexpected event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 18:16:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:16:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:16:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:16:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8478MB free_disk=25.058895111083984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:40 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Instance rebooted successfully.
Nov 14 18:16:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c5783e90-80ef-4824-a41d-b7bd8098aaa5 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.923s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance edd8f8ce-4a4a-4770-87c4-becece86b2d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b768391e-9952-4c91-a336-59ac7127b8ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance ee2ce386-76c6-49f8-bc69-453ecdf8eafb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:16:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:42 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:16:42 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:16:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:16:42 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:47 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:48 user nova-compute[76161]: INFO nova.compute.manager [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Terminating instance
Nov 14 18:16:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG nova.compute.manager [req-892b0e46-ce09-41f6-b297-1a4aeff6bddd req-b4e4f7c0-1702-44d8-b42c-b85ad968a82d service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received event network-vif-unplugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-892b0e46-ce09-41f6-b297-1a4aeff6bddd req-b4e4f7c0-1702-44d8-b42c-b85ad968a82d service nova] Acquiring lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-892b0e46-ce09-41f6-b297-1a4aeff6bddd req-b4e4f7c0-1702-44d8-b42c-b85ad968a82d service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-892b0e46-ce09-41f6-b297-1a4aeff6bddd req-b4e4f7c0-1702-44d8-b42c-b85ad968a82d service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-892b0e46-ce09-41f6-b297-1a4aeff6bddd req-b4e4f7c0-1702-44d8-b42c-b85ad968a82d service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] No waiting events found dispatching network-vif-unplugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-892b0e46-ce09-41f6-b297-1a4aeff6bddd req-b4e4f7c0-1702-44d8-b42c-b85ad968a82d service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received event network-vif-unplugged-a800e21d-ec45-4779-8901-2720815620b4 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Instance destroyed successfully.
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.objects.instance [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lazy-loading 'resources' on Instance uuid cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1296818343',display_name='tempest-VolumesActionsTest-instance-1296818343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1296818343',id=50,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:15:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64059d5429f2468f8dbcc256a47a5957',ramdisk_id='',reservation_id='r-buok93xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1577186745',owner_user_name='tempest-VolumesActionsTest-1577186745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:15:04Z,user_data=None,user_id='0f74d7304b3e40c389c28e84361ce1a0',uuid=cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a800e21d-ec45-4779-8901-2720815620b4", "address": "fa:16:3e:3e:25:7e", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa800e21d-ec", "ovs_interfaceid": "a800e21d-ec45-4779-8901-2720815620b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converting VIF {"id": "a800e21d-ec45-4779-8901-2720815620b4", "address": "fa:16:3e:3e:25:7e", "network": {"id": "ce80dfbd-3138-4311-b54e-14d896f2eeea", "bridge": "br-int", "label": "tempest-VolumesActionsTest-105776654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64059d5429f2468f8dbcc256a47a5957", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa800e21d-ec", "ovs_interfaceid": "a800e21d-ec45-4779-8901-2720815620b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:25:7e,bridge_name='br-int',has_traffic_filtering=True,id=a800e21d-ec45-4779-8901-2720815620b4,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa800e21d-ec') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG os_vif [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:25:7e,bridge_name='br-int',has_traffic_filtering=True,id=a800e21d-ec45-4779-8901-2720815620b4,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa800e21d-ec') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa800e21d-ec, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c73fdeeb-95dc-404c-9bac-847608ab0cad) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:16:49 user nova-compute[76161]: INFO os_vif [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:25:7e,bridge_name='br-int',has_traffic_filtering=True,id=a800e21d-ec45-4779-8901-2720815620b4,network=Network(ce80dfbd-3138-4311-b54e-14d896f2eeea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa800e21d-ec')
Nov 14 18:16:49 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Deleting instance files /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9_del
Nov 14 18:16:49 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Deletion of /opt/stack/data/nova/instances/cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9_del complete
Nov 14 18:16:49 user nova-compute[76161]: INFO nova.compute.manager [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 18:16:49 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:16:49 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Took 0.54 seconds to deallocate network for instance.
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.compute.manager [req-2a2b9859-5a31-43ab-9da9-e9942d9b7184 req-13df2da8-2629-43bf-a827-953300591d44 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received event network-vif-deleted-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:49 user nova-compute[76161]: INFO nova.compute.manager [req-2a2b9859-5a31-43ab-9da9-e9942d9b7184 req-13df2da8-2629-43bf-a827-953300591d44 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Neutron deleted interface a800e21d-ec45-4779-8901-2720815620b4; detaching it from the instance and deleting it from the info cache
Nov 14 18:16:49 user nova-compute[76161]: DEBUG nova.network.neutron [req-2a2b9859-5a31-43ab-9da9-e9942d9b7184 req-13df2da8-2629-43bf-a827-953300591d44 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:16:50 user nova-compute[76161]: DEBUG nova.compute.manager [req-2a2b9859-5a31-43ab-9da9-e9942d9b7184 req-13df2da8-2629-43bf-a827-953300591d44 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Detach interface failed, port_id=a800e21d-ec45-4779-8901-2720815620b4, reason: Instance cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9 could not be found. {{(pid=76161) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 18:16:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.006s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:50 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:16:50 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:16:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:50 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Deleted allocations for instance cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9
Nov 14 18:16:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f9ab089d-7719-4dcc-b6f4-308e2ff7c802 tempest-VolumesActionsTest-1577186745 tempest-VolumesActionsTest-1577186745-project-member] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.876s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received event network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] Acquiring lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] No waiting events found dispatching network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:51 user nova-compute[76161]: WARNING nova.compute.manager [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received unexpected event network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 for instance with vm_state deleted and task_state None.
Nov 14 18:16:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received event network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] Acquiring lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] No waiting events found dispatching network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:51 user nova-compute[76161]: WARNING nova.compute.manager [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received unexpected event network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 for instance with vm_state deleted and task_state None.
Nov 14 18:16:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received event network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] Acquiring lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] Lock "cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:16:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] No waiting events found dispatching network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:16:51 user nova-compute[76161]: WARNING nova.compute.manager [req-9eb98c42-200c-450b-9b4a-7b80cf34880e req-5d33d3e5-420f-463e-b2c4-743180a20d38 service nova] [instance: cfd37523-8f9f-4ccd-b944-0aa7fa44c1c9] Received unexpected event network-vif-plugged-a800e21d-ec45-4779-8901-2720815620b4 for instance with vm_state deleted and task_state None.
Nov 14 18:16:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:16:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:28 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:17:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:17:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:17:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:17:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:17:28 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updating instance_info_cache with network_info: [{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:17:28 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:17:28 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:17:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:17:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:17:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:17:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:17:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:17:33 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:17:33 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:17:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:17:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:17:35 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:17:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:17:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:17:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:17:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.074878692626953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:17:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:17:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance edd8f8ce-4a4a-4770-87c4-becece86b2d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:17:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b768391e-9952-4c91-a336-59ac7127b8ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:17:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance ee2ce386-76c6-49f8-bc69-453ecdf8eafb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:17:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:17:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:17:41 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:17:41 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:17:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:17:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:17:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:17:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:17:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:17:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:17:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:17:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:17:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:17:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:17:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-c4e9aedd-f994-4f61-b91b-c089c2a4c065 req-493059bf-6fb0-45f6-9515-08a8768a9144 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received event network-changed-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:18:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-c4e9aedd-f994-4f61-b91b-c089c2a4c065 req-493059bf-6fb0-45f6-9515-08a8768a9144 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Refreshing instance network info cache due to event network-changed-ed0e525d-f08e-4ba0-b60c-70d979928715. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:18:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c4e9aedd-f994-4f61-b91b-c089c2a4c065 req-493059bf-6fb0-45f6-9515-08a8768a9144 service nova] Acquiring lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:18:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c4e9aedd-f994-4f61-b91b-c089c2a4c065 req-493059bf-6fb0-45f6-9515-08a8768a9144 service nova] Acquired lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:18:13 user nova-compute[76161]: DEBUG nova.network.neutron [req-c4e9aedd-f994-4f61-b91b-c089c2a4c065 req-493059bf-6fb0-45f6-9515-08a8768a9144 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Refreshing network info cache for port ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:18:13 user nova-compute[76161]: DEBUG nova.network.neutron [req-c4e9aedd-f994-4f61-b91b-c089c2a4c065 req-493059bf-6fb0-45f6-9515-08a8768a9144 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Updated VIF entry in instance network info cache for port ed0e525d-f08e-4ba0-b60c-70d979928715. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:18:13 user nova-compute[76161]: DEBUG nova.network.neutron [req-c4e9aedd-f994-4f61-b91b-c089c2a4c065 req-493059bf-6fb0-45f6-9515-08a8768a9144 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Updating instance_info_cache with network_info: [{"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:18:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c4e9aedd-f994-4f61-b91b-c089c2a4c065 req-493059bf-6fb0-45f6-9515-08a8768a9144 service nova] Releasing lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:18:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-bb374933-348e-4f5a-9233-ef38f14762a7 req-de7060d7-91d2-4c8d-bce6-515fb7b6b328 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received event network-changed-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-bb374933-348e-4f5a-9233-ef38f14762a7 req-de7060d7-91d2-4c8d-bce6-515fb7b6b328 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Refreshing instance network info cache due to event network-changed-ed0e525d-f08e-4ba0-b60c-70d979928715. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bb374933-348e-4f5a-9233-ef38f14762a7 req-de7060d7-91d2-4c8d-bce6-515fb7b6b328 service nova] Acquiring lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bb374933-348e-4f5a-9233-ef38f14762a7 req-de7060d7-91d2-4c8d-bce6-515fb7b6b328 service nova] Acquired lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG nova.network.neutron [req-bb374933-348e-4f5a-9233-ef38f14762a7 req-de7060d7-91d2-4c8d-bce6-515fb7b6b328 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Refreshing network info cache for port ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:18:15 user nova-compute[76161]: INFO nova.compute.manager [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Terminating instance
Nov 14 18:18:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-47364d54-30f8-4938-81e7-b3770fff2fce req-a489f3e6-2b1d-416f-8d4e-988417bf38d0 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received event network-vif-unplugged-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-47364d54-30f8-4938-81e7-b3770fff2fce req-a489f3e6-2b1d-416f-8d4e-988417bf38d0 service nova] Acquiring lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-47364d54-30f8-4938-81e7-b3770fff2fce req-a489f3e6-2b1d-416f-8d4e-988417bf38d0 service nova] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-47364d54-30f8-4938-81e7-b3770fff2fce req-a489f3e6-2b1d-416f-8d4e-988417bf38d0 service nova] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-47364d54-30f8-4938-81e7-b3770fff2fce req-a489f3e6-2b1d-416f-8d4e-988417bf38d0 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] No waiting events found dispatching network-vif-unplugged-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-47364d54-30f8-4938-81e7-b3770fff2fce req-a489f3e6-2b1d-416f-8d4e-988417bf38d0 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received event network-vif-unplugged-ed0e525d-f08e-4ba0-b60c-70d979928715 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-bb374933-348e-4f5a-9233-ef38f14762a7 req-de7060d7-91d2-4c8d-bce6-515fb7b6b328 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Updated VIF entry in instance network info cache for port ed0e525d-f08e-4ba0-b60c-70d979928715. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-bb374933-348e-4f5a-9233-ef38f14762a7 req-de7060d7-91d2-4c8d-bce6-515fb7b6b328 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Updating instance_info_cache with network_info: [{"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-bb374933-348e-4f5a-9233-ef38f14762a7 req-de7060d7-91d2-4c8d-bce6-515fb7b6b328 service nova] Releasing lock "refresh_cache-ee2ce386-76c6-49f8-bc69-453ecdf8eafb" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:18:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Instance destroyed successfully.
Nov 14 18:18:16 user nova-compute[76161]: DEBUG nova.objects.instance [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'resources' on Instance uuid ee2ce386-76c6-49f8-bc69-453ecdf8eafb {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1350613177',display_name='tempest-TestVolumeBootPattern-server-1350613177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1350613177',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHVYDN2Xftf5V1grXUvkOAuZ4lRy2Yu8x71x7XZMVIMR4I5qKGZtkFKrVxApclfxwZHmCeNjcLNUIFGzVbzrwECoYdV2hlra8hiYCIDqSv04geiOynO7IsegUM2gQdCg==',key_name='tempest-TestVolumeBootPattern-706510423',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:16:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-547t6xo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:16:32Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=ee2ce386-76c6-49f8-bc69-453ecdf8eafb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "ed0e525d-f08e-4ba0-b60c-70d979928715", "address": "fa:16:3e:f0:6e:17", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0e525d-f0", "ovs_interfaceid": "ed0e525d-f08e-4ba0-b60c-70d979928715", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:6e:17,bridge_name='br-int',has_traffic_filtering=True,id=ed0e525d-f08e-4ba0-b60c-70d979928715,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0e525d-f0') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_vif [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:6e:17,bridge_name='br-int',has_traffic_filtering=True,id=ed0e525d-f08e-4ba0-b60c-70d979928715,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0e525d-f0') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped0e525d-f0, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72545baf-9733-4e6f-971d-e5e59d485e8e) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:18:16 user nova-compute[76161]: INFO os_vif [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:6e:17,bridge_name='br-int',has_traffic_filtering=True,id=ed0e525d-f08e-4ba0-b60c-70d979928715,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0e525d-f0')
Nov 14 18:18:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rewvlVCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:18:16 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4a2009-4c09-4819-9964-a43b669ddf8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a621b7f9-df11-4eb0-a091-c0c3d808ab9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:18:16 user nova-compute[76161]: No targets found.
Nov 14 18:18:16 user nova-compute[76161]: iSNS:
Nov 14 18:18:16 user nova-compute[76161]: No targets found.
Nov 14 18:18:16 user nova-compute[76161]: STATIC:
Nov 14 18:18:16 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a621b7f9-df11-4eb0-a091-c0c3d808ab9b
Nov 14 18:18:16 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:18:16 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:18:16 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e
Nov 14 18:18:16 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:18:16 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:18:16 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed
Nov 14 18:18:16 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:18:16 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:18:16 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8
Nov 14 18:18:16 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:18:16 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:18:16 user nova-compute[76161]: FIRMWARE:
Nov 14 18:18:16 user nova-compute[76161]: No targets found.
Nov 14 18:18:16 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:18:16 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:18:16 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c060735-e1d0-4718-8e06-640692d12fe2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a621b7f9-df11-4eb0-a091-c0c3d808ab9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d074418c-ab9a-47a5-94a4-4cb57c52d314]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a621b7f9-df11-4eb0-a091-c0c3d808ab9b (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:18:16 user nova-compute[76161]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)
Nov 14 18:18:16 user nova-compute[76161]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:18:16 user nova-compute[76161]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a621b7f9-df11-4eb0-a091-c0c3d808ab9b (non-flash)
Nov 14 18:18:16 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:18:16 user nova-compute[76161]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed (non-flash)
Nov 14 18:18:16 user nova-compute[76161]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:18:16 user nova-compute[76161]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a621b7f9-df11-4eb0-a091-c0c3d808ab9b (non-flash)
Nov 14 18:18:16 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d06c3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed'): ({'sdd'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Removing single pathed devices sdd {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c13cd60-d36a-4fd8-944c-1dd6c142c0e1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b49b34d-71c3-4367-840f-0ac03378c134]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flushing IO for device /dev/sdd {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe54653-3a3d-46f2-a663-e346f4904b7c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.066s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2757dfd9-6795-4954-9ae2-ec7e10351a7c]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] SCSI volumes sdd have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a037ca-476a-4b64-b72d-2e4f0d214eb8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a597d4-70c3-40ee-98c3-8fc2d7acad0a]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed, portal: 172.16.0.220,3260]
Nov 14 18:18:16 user nova-compute[76161]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed, portal: 172.16.0.220,3260] successful.
Nov 14 18:18:16 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71fb36d-a619-4319-b204-7ff8e4e5bbed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39f12ed-c0af-47fb-b752-a5147e01bb63]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== disconnect_volume: return (345ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:18:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Deleting instance files /opt/stack/data/nova/instances/ee2ce386-76c6-49f8-bc69-453ecdf8eafb_del
Nov 14 18:18:16 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Deletion of /opt/stack/data/nova/instances/ee2ce386-76c6-49f8-bc69-453ecdf8eafb_del complete
Nov 14 18:18:16 user nova-compute[76161]: INFO nova.compute.manager [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 14 18:18:16 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:18:16 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:18:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:17 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:18:17 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Took 0.84 seconds to deallocate network for instance.
Nov 14 18:18:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-ef59188a-c3c0-4120-b873-0d3170e21753 req-9d21fb22-19cc-4a47-a459-9445bd09d445 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received event network-vif-deleted-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:18:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-dc0618d7-a601-460c-a8ab-2e686d954b4c req-17ae8e42-8d75-4c40-8fe5-9d47e83f4e54 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received event network-vif-plugged-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:18:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dc0618d7-a601-460c-a8ab-2e686d954b4c req-17ae8e42-8d75-4c40-8fe5-9d47e83f4e54 service nova] Acquiring lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:18:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dc0618d7-a601-460c-a8ab-2e686d954b4c req-17ae8e42-8d75-4c40-8fe5-9d47e83f4e54 service nova] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:18:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dc0618d7-a601-460c-a8ab-2e686d954b4c req-17ae8e42-8d75-4c40-8fe5-9d47e83f4e54 service nova] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:18:17 user nova-compute[76161]: DEBUG nova.compute.manager [req-dc0618d7-a601-460c-a8ab-2e686d954b4c req-17ae8e42-8d75-4c40-8fe5-9d47e83f4e54 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] No waiting events found dispatching network-vif-plugged-ed0e525d-f08e-4ba0-b60c-70d979928715 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:18:17 user nova-compute[76161]: WARNING nova.compute.manager [req-dc0618d7-a601-460c-a8ab-2e686d954b4c req-17ae8e42-8d75-4c40-8fe5-9d47e83f4e54 service nova] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Received unexpected event network-vif-plugged-ed0e525d-f08e-4ba0-b60c-70d979928715 for instance with vm_state active and task_state deleting.
Nov 14 18:18:18 user nova-compute[76161]: INFO nova.compute.manager [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: ee2ce386-76c6-49f8-bc69-453ecdf8eafb] Took 0.77 seconds to detach 1 volumes for instance.
Nov 14 18:18:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:18:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:18:18 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:18:18 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:18:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:18:18 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Deleted allocations for instance ee2ce386-76c6-49f8-bc69-453ecdf8eafb
Nov 14 18:18:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-f0fa0d54-fc30-4511-8418-bd649ad498be tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "ee2ce386-76c6-49f8-bc69-453ecdf8eafb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.186s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:18:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-1231cc30-e643-4fd5-a641-7202504aebe9 req-9b80b627-50c9-4d00-b19c-2aca46fba4f6 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-changed-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:18:25 user nova-compute[76161]: DEBUG nova.compute.manager [req-1231cc30-e643-4fd5-a641-7202504aebe9 req-9b80b627-50c9-4d00-b19c-2aca46fba4f6 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Refreshing instance network info cache due to event network-changed-85a65a97-cac5-41c2-9943-4cbc64cb9c21. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:18:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1231cc30-e643-4fd5-a641-7202504aebe9 req-9b80b627-50c9-4d00-b19c-2aca46fba4f6 service nova] Acquiring lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:18:25 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1231cc30-e643-4fd5-a641-7202504aebe9 req-9b80b627-50c9-4d00-b19c-2aca46fba4f6 service nova] Acquired lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:18:25 user nova-compute[76161]: DEBUG nova.network.neutron [req-1231cc30-e643-4fd5-a641-7202504aebe9 req-9b80b627-50c9-4d00-b19c-2aca46fba4f6 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Refreshing network info cache for port 85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:18:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-1231cc30-e643-4fd5-a641-7202504aebe9 req-9b80b627-50c9-4d00-b19c-2aca46fba4f6 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updated VIF entry in instance network info cache for port 85a65a97-cac5-41c2-9943-4cbc64cb9c21. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-1231cc30-e643-4fd5-a641-7202504aebe9 req-9b80b627-50c9-4d00-b19c-2aca46fba4f6 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updating instance_info_cache with network_info: [{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-1231cc30-e643-4fd5-a641-7202504aebe9 req-9b80b627-50c9-4d00-b19c-2aca46fba4f6 service nova] Releasing lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-60823b54-bcc7-4328-9361-2b585d7540a2 req-45167a1f-686f-4016-b8d4-6ac3a556ed91 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-changed-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG nova.compute.manager [req-60823b54-bcc7-4328-9361-2b585d7540a2 req-45167a1f-686f-4016-b8d4-6ac3a556ed91 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Refreshing instance network info cache due to event network-changed-85a65a97-cac5-41c2-9943-4cbc64cb9c21. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-60823b54-bcc7-4328-9361-2b585d7540a2 req-45167a1f-686f-4016-b8d4-6ac3a556ed91 service nova] Acquiring lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-60823b54-bcc7-4328-9361-2b585d7540a2 req-45167a1f-686f-4016-b8d4-6ac3a556ed91 service nova] Acquired lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG nova.network.neutron [req-60823b54-bcc7-4328-9361-2b585d7540a2 req-45167a1f-686f-4016-b8d4-6ac3a556ed91 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Refreshing network info cache for port 85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:18:26 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:18:27 user nova-compute[76161]: INFO nova.compute.manager [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Detaching volume 98a7a461-4fa9-40dc-ab86-1196caf1efe8
Nov 14 18:18:27 user nova-compute[76161]: INFO nova.virt.block_device [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Attempting to driver detach volume 98a7a461-4fa9-40dc-ab86-1196caf1efe8 from mountpoint /dev/vdb
Nov 14 18:18:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Attempting to detach device vdb from instance b768391e-9952-4c91-a336-59ac7127b8ca from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:18:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:18:27 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:18:27 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:18:27 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:18:27 user nova-compute[76161]:   <serial>98a7a461-4fa9-40dc-ab86-1196caf1efe8</serial>
Nov 14 18:18:27 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 18:18:27 user nova-compute[76161]: </disk>
Nov 14 18:18:27 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:18:27 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Successfully detached device vdb from instance b768391e-9952-4c91-a336-59ac7127b8ca from the persistent domain config.
Nov 14 18:18:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b768391e-9952-4c91-a336-59ac7127b8ca from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:18:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:18:27 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:18:27 user nova-compute[76161]:   <source dev="/dev/sdc"/>
Nov 14 18:18:27 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:18:27 user nova-compute[76161]:   <serial>98a7a461-4fa9-40dc-ab86-1196caf1efe8</serial>
Nov 14 18:18:27 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 18:18:27 user nova-compute[76161]: </disk>
Nov 14 18:18:27 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:18:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-60823b54-bcc7-4328-9361-2b585d7540a2 req-45167a1f-686f-4016-b8d4-6ac3a556ed91 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updated VIF entry in instance network info cache for port 85a65a97-cac5-41c2-9943-4cbc64cb9c21. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:18:27 user nova-compute[76161]: DEBUG nova.network.neutron [req-60823b54-bcc7-4328-9361-2b585d7540a2 req-45167a1f-686f-4016-b8d4-6ac3a556ed91 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updating instance_info_cache with network_info: [{"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:18:27 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-60823b54-bcc7-4328-9361-2b585d7540a2 req-45167a1f-686f-4016-b8d4-6ac3a556ed91 service nova] Releasing lock "refresh_cache-b768391e-9952-4c91-a336-59ac7127b8ca" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:18:27 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:18:30 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:18:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:18:30 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 18:18:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:18:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:18:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:18:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:18:35 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:18:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:18:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:40 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:18:41 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:18:41 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:18:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8730MB free_disk=25.062389373779297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance edd8f8ce-4a4a-4770-87c4-becece86b2d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance b768391e-9952-4c91-a336-59ac7127b8ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:18:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:18:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:18:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:18:47 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b768391e-9952-4c91-a336-59ac7127b8ca is timed out.
Nov 14 18:18:47 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Successfully detached device vdb from instance b768391e-9952-4c91-a336-59ac7127b8ca from the live domain config.
Nov 14 18:18:47 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVlPjMDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:18:47 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5466b8-3999-4f43-b714-254e40b0d8e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:18:47 user nova-compute[76161]: No targets found.
Nov 14 18:18:47 user nova-compute[76161]: iSNS:
Nov 14 18:18:47 user nova-compute[76161]: No targets found.
Nov 14 18:18:47 user nova-compute[76161]: STATIC:
Nov 14 18:18:47 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e
Nov 14 18:18:47 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:18:47 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:18:47 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8
Nov 14 18:18:47 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:18:47 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:18:47 user nova-compute[76161]: FIRMWARE:
Nov 14 18:18:47 user nova-compute[76161]: No targets found.
Nov 14 18:18:47 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:18:47 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:18:47 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f64d3d6-f43a-40cb-a360-bec915549310]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e99e3b7-f68c-45e9-83db-fe2d52ef2096]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:18:47 user nova-compute[76161]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:18:47 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:18:47 user nova-compute[76161]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 (non-flash)
Nov 14 18:18:47 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d062a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8'): ({'sdc'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Removing single pathed devices sdc {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[064bf8de-5911-4471-b56c-93d7624d8e22]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f95edd-eca4-4d19-977b-b630e7904e62]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Flushing IO for device /dev/sdc {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a74698-5810-43f3-9e77-2aed5b4d650e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8887a42-1128-41ca-98cb-952f1a58b0aa]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] SCSI volumes sdc have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e17953-17a6-4656-8ce4-a0ed04e49047]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:47 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[246a672e-00bd-4a4d-bc95-65c48edd7f9b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260]
Nov 14 18:18:48 user nova-compute[76161]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8, portal: 172.16.0.220,3260] successful.
Nov 14 18:18:48 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:18:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:18:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7a461-4fa9-40dc-ab86-1196caf1efe8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:18:48 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[07063356-5fa7-4579-a6a8-0e4f81d52132]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:18:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:18:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:18:48 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] <== disconnect_volume: return (306ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:18:48 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:18:48 user nova-compute[76161]: DEBUG nova.objects.instance [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'flavor' on Instance uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:18:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-fdaa46d1-ef86-4ef6-9799-befc12284d21 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.872s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:18:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:18:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-dba82d5f-c0e4-4144-8eca-20c3851e4975 req-e5438b46-c774-47e7-889c-fd85b7b1ba97 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received event network-changed-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-dba82d5f-c0e4-4144-8eca-20c3851e4975 req-e5438b46-c774-47e7-889c-fd85b7b1ba97 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Refreshing instance network info cache due to event network-changed-0c711a49-404c-480b-87e1-dc2560ad2844. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dba82d5f-c0e4-4144-8eca-20c3851e4975 req-e5438b46-c774-47e7-889c-fd85b7b1ba97 service nova] Acquiring lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dba82d5f-c0e4-4144-8eca-20c3851e4975 req-e5438b46-c774-47e7-889c-fd85b7b1ba97 service nova] Acquired lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG nova.network.neutron [req-dba82d5f-c0e4-4144-8eca-20c3851e4975 req-e5438b46-c774-47e7-889c-fd85b7b1ba97 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Refreshing network info cache for port 0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:10 user nova-compute[76161]: INFO nova.compute.manager [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Terminating instance
Nov 14 18:19:10 user nova-compute[76161]: DEBUG nova.compute.manager [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-d8d6c3a5-7880-48fd-b51c-d713d6906f2a req-c34d2905-0d83-4ba8-a53c-5e741fa9e7dc service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received event network-vif-unplugged-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d8d6c3a5-7880-48fd-b51c-d713d6906f2a req-c34d2905-0d83-4ba8-a53c-5e741fa9e7dc service nova] Acquiring lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d8d6c3a5-7880-48fd-b51c-d713d6906f2a req-c34d2905-0d83-4ba8-a53c-5e741fa9e7dc service nova] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-d8d6c3a5-7880-48fd-b51c-d713d6906f2a req-c34d2905-0d83-4ba8-a53c-5e741fa9e7dc service nova] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-d8d6c3a5-7880-48fd-b51c-d713d6906f2a req-c34d2905-0d83-4ba8-a53c-5e741fa9e7dc service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] No waiting events found dispatching network-vif-unplugged-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG nova.compute.manager [req-d8d6c3a5-7880-48fd-b51c-d713d6906f2a req-c34d2905-0d83-4ba8-a53c-5e741fa9e7dc service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received event network-vif-unplugged-0c711a49-404c-480b-87e1-dc2560ad2844 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG nova.network.neutron [req-dba82d5f-c0e4-4144-8eca-20c3851e4975 req-e5438b46-c774-47e7-889c-fd85b7b1ba97 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Updated VIF entry in instance network info cache for port 0c711a49-404c-480b-87e1-dc2560ad2844. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG nova.network.neutron [req-dba82d5f-c0e4-4144-8eca-20c3851e4975 req-e5438b46-c774-47e7-889c-fd85b7b1ba97 service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Updating instance_info_cache with network_info: [{"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:19:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dba82d5f-c0e4-4144-8eca-20c3851e4975 req-e5438b46-c774-47e7-889c-fd85b7b1ba97 service nova] Releasing lock "refresh_cache-edd8f8ce-4a4a-4770-87c4-becece86b2d8" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:19:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Instance destroyed successfully.
Nov 14 18:19:11 user nova-compute[76161]: DEBUG nova.objects.instance [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lazy-loading 'resources' on Instance uuid edd8f8ce-4a4a-4770-87c4-becece86b2d8 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1848715146',display_name='tempest-TestVolumeBootPattern-server-1848715146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1848715146',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHVYDN2Xftf5V1grXUvkOAuZ4lRy2Yu8x71x7XZMVIMR4I5qKGZtkFKrVxApclfxwZHmCeNjcLNUIFGzVbzrwECoYdV2hlra8hiYCIDqSv04geiOynO7IsegUM2gQdCg==',key_name='tempest-TestVolumeBootPattern-706510423',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:14:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81682e21827c4572b1659004cc22215a',ramdisk_id='',reservation_id='r-8fomdp3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1727647616',owner_user_name='tempest-TestVolumeBootPattern-1727647616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:14:36Z,user_data=None,user_id='d22a86988e6043d2ab950e0d6e557ef8',uuid=edd8f8ce-4a4a-4770-87c4-becece86b2d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converting VIF {"id": "0c711a49-404c-480b-87e1-dc2560ad2844", "address": "fa:16:3e:3b:62:f4", "network": {"id": "436e6a31-3baa-4f38-8b2c-2cbcd14a3d92", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641665100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81682e21827c4572b1659004cc22215a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c711a49-40", "ovs_interfaceid": "0c711a49-404c-480b-87e1-dc2560ad2844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:62:f4,bridge_name='br-int',has_traffic_filtering=True,id=0c711a49-404c-480b-87e1-dc2560ad2844,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c711a49-40') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_vif [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:62:f4,bridge_name='br-int',has_traffic_filtering=True,id=0c711a49-404c-480b-87e1-dc2560ad2844,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c711a49-40') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c711a49-40, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62214763-65fa-4a21-b3e9-33ed2371b345) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:19:11 user nova-compute[76161]: INFO os_vif [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:62:f4,bridge_name='br-int',has_traffic_filtering=True,id=0c711a49-404c-480b-87e1-dc2560ad2844,network=Network(436e6a31-3baa-4f38-8b2c-2cbcd14a3d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c711a49-40')
Nov 14 18:19:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UnCHeIof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:19:11 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4e3d1d-a0f6-4189-80f1-0b7bb558b4d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:19:11 user nova-compute[76161]: No targets found.
Nov 14 18:19:11 user nova-compute[76161]: iSNS:
Nov 14 18:19:11 user nova-compute[76161]: No targets found.
Nov 14 18:19:11 user nova-compute[76161]: STATIC:
Nov 14 18:19:11 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e
Nov 14 18:19:11 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:19:11 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:19:11 user nova-compute[76161]: FIRMWARE:
Nov 14 18:19:11 user nova-compute[76161]: No targets found.
Nov 14 18:19:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:19:11 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:19:11 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faa1f01-48ab-4f2b-9541-7ef02996760b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[374b897d-e11a-4865-810c-38d610566302]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:19:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e (non-flash)
Nov 14 18:19:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f8423d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1126ab7f-ba85-4619-afd7-21a5ab76ad36]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1353bebd-31e5-4e34-a76c-829bd0a3bd03]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e287d1-6203-4436-bc92-4669a8a6a7d3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d11d2f9-3ef1-4088-9fce-999221381a11]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7356c3-5a1d-45e6-b900-d792e80265a7]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceee5182-b465-467b-8df9-37edc5df7825]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260]
Nov 14 18:19:11 user nova-compute[76161]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e, portal: 172.16.0.220,3260] successful.
Nov 14 18:19:11 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b45bd9-d89b-4ed9-a248-f2bebec9e71e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae5e389-fe39-4ee2-9d2a-e423cd1fd03c]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] <== disconnect_volume: return (294ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:19:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Deleting instance files /opt/stack/data/nova/instances/edd8f8ce-4a4a-4770-87c4-becece86b2d8_del
Nov 14 18:19:11 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Deletion of /opt/stack/data/nova/instances/edd8f8ce-4a4a-4770-87c4-becece86b2d8_del complete
Nov 14 18:19:11 user nova-compute[76161]: INFO nova.compute.manager [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 18:19:11 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:19:11 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:19:12 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:19:12 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Took 0.63 seconds to deallocate network for instance.
Nov 14 18:19:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-d6dc0181-438e-4749-8e67-2d1eb89275de req-81d152d0-d56a-4a01-a022-044a043a03ac service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received event network-vif-deleted-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:19:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-5f5e8ef1-47e1-4965-9962-02c8f0646921 req-28bc420d-21e6-4568-adc4-67e9f1ab206a service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received event network-vif-plugged-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:19:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5f5e8ef1-47e1-4965-9962-02c8f0646921 req-28bc420d-21e6-4568-adc4-67e9f1ab206a service nova] Acquiring lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5f5e8ef1-47e1-4965-9962-02c8f0646921 req-28bc420d-21e6-4568-adc4-67e9f1ab206a service nova] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-5f5e8ef1-47e1-4965-9962-02c8f0646921 req-28bc420d-21e6-4568-adc4-67e9f1ab206a service nova] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:12 user nova-compute[76161]: DEBUG nova.compute.manager [req-5f5e8ef1-47e1-4965-9962-02c8f0646921 req-28bc420d-21e6-4568-adc4-67e9f1ab206a service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] No waiting events found dispatching network-vif-plugged-0c711a49-404c-480b-87e1-dc2560ad2844 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:19:12 user nova-compute[76161]: WARNING nova.compute.manager [req-5f5e8ef1-47e1-4965-9962-02c8f0646921 req-28bc420d-21e6-4568-adc4-67e9f1ab206a service nova] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Received unexpected event network-vif-plugged-0c711a49-404c-480b-87e1-dc2560ad2844 for instance with vm_state active and task_state deleting.
Nov 14 18:19:12 user nova-compute[76161]: INFO nova.compute.manager [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] [instance: edd8f8ce-4a4a-4770-87c4-becece86b2d8] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 18:19:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:12 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:19:13 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:19:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:13 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Deleted allocations for instance edd8f8ce-4a4a-4770-87c4-becece86b2d8
Nov 14 18:19:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-1b42957f-05ae-4050-a202-e617e6ce132e tempest-TestVolumeBootPattern-1727647616 tempest-TestVolumeBootPattern-1727647616-project-member] Lock "edd8f8ce-4a4a-4770-87c4-becece86b2d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.893s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:19 user nova-compute[76161]: INFO nova.compute.manager [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Terminating instance
Nov 14 18:19:19 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-669f79e3-4be2-472b-a5be-50f9fa24083d req-15968aec-c643-4c9c-b124-e138773731bf service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-vif-unplugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-669f79e3-4be2-472b-a5be-50f9fa24083d req-15968aec-c643-4c9c-b124-e138773731bf service nova] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-669f79e3-4be2-472b-a5be-50f9fa24083d req-15968aec-c643-4c9c-b124-e138773731bf service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-669f79e3-4be2-472b-a5be-50f9fa24083d req-15968aec-c643-4c9c-b124-e138773731bf service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-669f79e3-4be2-472b-a5be-50f9fa24083d req-15968aec-c643-4c9c-b124-e138773731bf service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] No waiting events found dispatching network-vif-unplugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:19:19 user nova-compute[76161]: DEBUG nova.compute.manager [req-669f79e3-4be2-472b-a5be-50f9fa24083d req-15968aec-c643-4c9c-b124-e138773731bf service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-vif-unplugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:19:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Instance destroyed successfully.
Nov 14 18:19:20 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'resources' on Instance uuid b768391e-9952-4c91-a336-59ac7127b8ca {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1070282106',display_name='tempest-TestMinimumBasicScenario-server-1070282106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1070282106',id=49,image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjEeSYdg8v8pt4SmYmzNQO5ZL1McegI+xu8cN/VHJTsi7Bn6WW6HjSG4OAYHkziGNE2clc6cJDmcYgvtcc5fazdsZIGzLsPjKOgooFUT+gajlYmF81p6ViKBNYNiRyEJA==',key_name='tempest-TestMinimumBasicScenario-1264911207',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83e313849c0b452e9dd6f5afd4006e31',ramdisk_id='',reservation_id='r-wpw69b78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7640a2d0-54ea-4669-a8db-a1f48011dda6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-451246924',owner_user_name='tempest-TestMinimumBasicScenario-451246924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:16:41Z,user_data=None,user_id='fcb6dc8c680145809756f79ccc78ead8',uuid=b768391e-9952-4c91-a336-59ac7127b8ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converting VIF {"id": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "address": "fa:16:3e:7a:38:21", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a65a97-ca", "ovs_interfaceid": "85a65a97-cac5-41c2-9943-4cbc64cb9c21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG os_vif [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85a65a97-ca, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f0057e1-cc2f-4a4c-8cca-94404d59b9d8) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:19:20 user nova-compute[76161]: INFO os_vif [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:38:21,bridge_name='br-int',has_traffic_filtering=True,id=85a65a97-cac5-41c2-9943-4cbc64cb9c21,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a65a97-ca')
Nov 14 18:19:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Deleting instance files /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca_del
Nov 14 18:19:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Deletion of /opt/stack/data/nova/instances/b768391e-9952-4c91-a336-59ac7127b8ca_del complete
Nov 14 18:19:20 user nova-compute[76161]: INFO nova.compute.manager [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 18:19:20 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:19:20 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Took 0.52 seconds to deallocate network for instance.
Nov 14 18:19:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-5c45069b-36da-4cc9-8676-03cb0a302392 req-dd716437-e8c8-4db6-80cb-c3f104afee11 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-vif-deleted-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:19:20 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:19:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:21 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Deleted allocations for instance b768391e-9952-4c91-a336-59ac7127b8ca
Nov 14 18:19:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7fb3e2ea-ae43-44ea-a091-caf608d32531 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "b768391e-9952-4c91-a336-59ac7127b8ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.670s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-751007bf-d9ae-42ef-a9c7-14ab6bd8b858 req-bab983a3-22f8-45c8-b58a-4e0ad94716f5 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:19:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-751007bf-d9ae-42ef-a9c7-14ab6bd8b858 req-bab983a3-22f8-45c8-b58a-4e0ad94716f5 service nova] Acquiring lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-751007bf-d9ae-42ef-a9c7-14ab6bd8b858 req-bab983a3-22f8-45c8-b58a-4e0ad94716f5 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:21 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-751007bf-d9ae-42ef-a9c7-14ab6bd8b858 req-bab983a3-22f8-45c8-b58a-4e0ad94716f5 service nova] Lock "b768391e-9952-4c91-a336-59ac7127b8ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:21 user nova-compute[76161]: DEBUG nova.compute.manager [req-751007bf-d9ae-42ef-a9c7-14ab6bd8b858 req-bab983a3-22f8-45c8-b58a-4e0ad94716f5 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] No waiting events found dispatching network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:19:21 user nova-compute[76161]: WARNING nova.compute.manager [req-751007bf-d9ae-42ef-a9c7-14ab6bd8b858 req-bab983a3-22f8-45c8-b58a-4e0ad94716f5 service nova] [instance: b768391e-9952-4c91-a336-59ac7127b8ca] Received unexpected event network-vif-plugged-85a65a97-cac5-41c2-9943-4cbc64cb9c21 for instance with vm_state deleted and task_state None.
Nov 14 18:19:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:19:31 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:19:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:19:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:19:31 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 18:19:35 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:19:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:19:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:19:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:19:37 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:19:38 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:19:40 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:19:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=9078MB free_disk=25.089115142822266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:19:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:19:42 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:19:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:19:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:19:44 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:19:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:19:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:19:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:19:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:19:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:19:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:19:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:20:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:20:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:20:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:20:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:20:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:20:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:20:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:20:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:20:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:20:13 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:20:13 user nova-compute[76161]: INFO nova.compute.claims [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Claim successful on node user
Nov 14 18:20:13 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:20:13 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG nova.network.neutron [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:20:14 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:20:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG nova.policy [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcb6dc8c680145809756f79ccc78ead8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e313849c0b452e9dd6f5afd4006e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG nova.compute.manager [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:20:14 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Creating image(s)
Nov 14 18:20:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "/opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "/opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "/opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "3103be68c4e2625837bad5e756a5c21a5677ade9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "3103be68c4e2625837bad5e756a5c21a5677ade9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:20:14 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9.part --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9.part --force-share --output=json" returned: 0 in 0.209s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG nova.virt.images [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] 24441554-b774-4a0b-85d8-6468d7886142 was qcow2, converting to raw {{(pid=76161) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG nova.privsep.utils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76161) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9.part /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9.converted {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9.part /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9.converted" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9.converted --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG nova.network.neutron [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Successfully created port: 6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9.converted --force-share --output=json" returned: 0 in 0.331s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "3103be68c4e2625837bad5e756a5c21a5677ade9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.275s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9 --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "3103be68c4e2625837bad5e756a5c21a5677ade9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "3103be68c4e2625837bad5e756a5c21a5677ade9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9 --force-share --output=json" returned: 0 in 0.172s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9,backing_fmt=raw /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9,backing_fmt=raw /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk 1073741824" returned: 0 in 0.052s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "3103be68c4e2625837bad5e756a5c21a5677ade9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:20:15 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9 --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Successfully updated port: 6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.compute.manager [req-23b71204-7e5c-41f7-b33a-5aafab774fcb req-f58c4dd5-2528-41d4-8d4d-10ca87b938aa service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-changed-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.compute.manager [req-23b71204-7e5c-41f7-b33a-5aafab774fcb req-f58c4dd5-2528-41d4-8d4d-10ca87b938aa service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Refreshing instance network info cache due to event network-changed-6be22d43-be99-4c35-a55a-a35424ce0611. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23b71204-7e5c-41f7-b33a-5aafab774fcb req-f58c4dd5-2528-41d4-8d4d-10ca87b938aa service nova] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9 --force-share --output=json" returned: 0 in 0.169s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Checking if we can resize image /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Cannot resize image /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Ensure instance console log exists: /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.neutron [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.compute.manager [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Instance network_info: |[{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23b71204-7e5c-41f7-b33a-5aafab774fcb req-f58c4dd5-2528-41d4-8d4d-10ca87b938aa service nova] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-23b71204-7e5c-41f7-b33a-5aafab774fcb req-f58c4dd5-2528-41d4-8d4d-10ca87b938aa service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Refreshing network info cache for port 6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Start _get_guest_xml network_info=[{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T18:20:11Z,direct_url=<?>,disk_format='qcow2',id=24441554-b774-4a0b-85d8-6468d7886142,min_disk=0,min_ram=0,name='tempest-scenario-img--1197659187',owner='83e313849c0b452e9dd6f5afd4006e31',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T18:20:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '24441554-b774-4a0b-85d8-6468d7886142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:20:16 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:20:16 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T18:20:11Z,direct_url=<?>,disk_format='qcow2',id=24441554-b774-4a0b-85d8-6468d7886142,min_disk=0,min_ram=0,name='tempest-scenario-img--1197659187',owner='83e313849c0b452e9dd6f5afd4006e31',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T18:20:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1627430512',display_name='tempest-TestMinimumBasicScenario-server-1627430512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1627430512',id=52,image_ref='24441554-b774-4a0b-85d8-6468d7886142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAJnNb6JUcj9utG1QT7lNDUly56ay6g2zMsKL1wyE6xsg5ys37JGLcThcKh4qqR4QTkNJbIaHg5wLkbO1R2FcMmW+VXGtXCz82RJ6YSz+SrgIB76yllEeC+5WBu7AXH9w==',key_name='tempest-TestMinimumBasicScenario-576597934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e313849c0b452e9dd6f5afd4006e31',ramdisk_id='',reservation_id='r-d93iyd8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='24441554-b774-4a0b-85d8-6468d7886142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-451246924',owner_user_name='tempest-TestMinimumBasicScenario-451246924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:20:14Z,user_data=None,user_id='fcb6dc8c680145809756f79ccc78ead8',uuid=846cc821-b29f-4f7a-b4be-ded0cd02ff40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converting VIF {"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:64:37,bridge_name='br-int',has_traffic_filtering=True,id=6be22d43-be99-4c35-a55a-a35424ce0611,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be22d43-be') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.objects.instance [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'pci_devices' on Instance uuid 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:20:16 user nova-compute[76161]:   <uuid>846cc821-b29f-4f7a-b4be-ded0cd02ff40</uuid>
Nov 14 18:20:16 user nova-compute[76161]:   <name>instance-00000034</name>
Nov 14 18:20:16 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:20:16 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:20:16 user nova-compute[76161]:   <metadata>
Nov 14 18:20:16 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:20:16 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:20:16 user nova-compute[76161]:       <nova:name>tempest-TestMinimumBasicScenario-server-1627430512</nova:name>
Nov 14 18:20:16 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:20:16</nova:creationTime>
Nov 14 18:20:16 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:20:16 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:20:16 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:20:16 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:20:16 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:20:16 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:20:16 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:20:16 user nova-compute[76161]:       <nova:owner>
Nov 14 18:20:16 user nova-compute[76161]:         <nova:user uuid="fcb6dc8c680145809756f79ccc78ead8">tempest-TestMinimumBasicScenario-451246924-project-member</nova:user>
Nov 14 18:20:16 user nova-compute[76161]:         <nova:project uuid="83e313849c0b452e9dd6f5afd4006e31">tempest-TestMinimumBasicScenario-451246924</nova:project>
Nov 14 18:20:16 user nova-compute[76161]:       </nova:owner>
Nov 14 18:20:16 user nova-compute[76161]:       <nova:root type="image" uuid="24441554-b774-4a0b-85d8-6468d7886142"/>
Nov 14 18:20:16 user nova-compute[76161]:       <nova:ports>
Nov 14 18:20:16 user nova-compute[76161]:         <nova:port uuid="6be22d43-be99-4c35-a55a-a35424ce0611">
Nov 14 18:20:16 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 18:20:16 user nova-compute[76161]:         </nova:port>
Nov 14 18:20:16 user nova-compute[76161]:       </nova:ports>
Nov 14 18:20:16 user nova-compute[76161]:     </nova:instance>
Nov 14 18:20:16 user nova-compute[76161]:   </metadata>
Nov 14 18:20:16 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:20:16 user nova-compute[76161]:     <system>
Nov 14 18:20:16 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:20:16 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:20:16 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:20:16 user nova-compute[76161]:       <entry name="serial">846cc821-b29f-4f7a-b4be-ded0cd02ff40</entry>
Nov 14 18:20:16 user nova-compute[76161]:       <entry name="uuid">846cc821-b29f-4f7a-b4be-ded0cd02ff40</entry>
Nov 14 18:20:16 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:20:16 user nova-compute[76161]:     </system>
Nov 14 18:20:16 user nova-compute[76161]:   </sysinfo>
Nov 14 18:20:16 user nova-compute[76161]:   <os>
Nov 14 18:20:16 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:20:16 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:20:16 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:20:16 user nova-compute[76161]:   </os>
Nov 14 18:20:16 user nova-compute[76161]:   <features>
Nov 14 18:20:16 user nova-compute[76161]:     <acpi/>
Nov 14 18:20:16 user nova-compute[76161]:     <apic/>
Nov 14 18:20:16 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:20:16 user nova-compute[76161]:   </features>
Nov 14 18:20:16 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:20:16 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:20:16 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:20:16 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:20:16 user nova-compute[76161]:   </clock>
Nov 14 18:20:16 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:20:16 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:20:16 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:20:16 user nova-compute[76161]:   </cpu>
Nov 14 18:20:16 user nova-compute[76161]:   <devices>
Nov 14 18:20:16 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:20:16 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:20:16 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk"/>
Nov 14 18:20:16 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:20:16 user nova-compute[76161]:     </disk>
Nov 14 18:20:16 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:20:16 user nova-compute[76161]:       <mac address="fa:16:3e:dc:64:37"/>
Nov 14 18:20:16 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:20:16 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:20:16 user nova-compute[76161]:       <target dev="tap6be22d43-be"/>
Nov 14 18:20:16 user nova-compute[76161]:     </interface>
Nov 14 18:20:16 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:20:16 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/console.log" append="off"/>
Nov 14 18:20:16 user nova-compute[76161]:     </serial>
Nov 14 18:20:16 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:20:16 user nova-compute[76161]:     <video>
Nov 14 18:20:16 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:20:16 user nova-compute[76161]:     </video>
Nov 14 18:20:16 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:20:16 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:20:16 user nova-compute[76161]:     </rng>
Nov 14 18:20:16 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:20:16 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:20:16 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:20:16 user nova-compute[76161]:     </memballoon>
Nov 14 18:20:16 user nova-compute[76161]:   </devices>
Nov 14 18:20:16 user nova-compute[76161]: </domain>
Nov 14 18:20:16 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1627430512',display_name='tempest-TestMinimumBasicScenario-server-1627430512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1627430512',id=52,image_ref='24441554-b774-4a0b-85d8-6468d7886142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAJnNb6JUcj9utG1QT7lNDUly56ay6g2zMsKL1wyE6xsg5ys37JGLcThcKh4qqR4QTkNJbIaHg5wLkbO1R2FcMmW+VXGtXCz82RJ6YSz+SrgIB76yllEeC+5WBu7AXH9w==',key_name='tempest-TestMinimumBasicScenario-576597934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83e313849c0b452e9dd6f5afd4006e31',ramdisk_id='',reservation_id='r-d93iyd8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='24441554-b774-4a0b-85d8-6468d7886142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-451246924',owner_user_name='tempest-TestMinimumBasicScenario-451246924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:20:14Z,user_data=None,user_id='fcb6dc8c680145809756f79ccc78ead8',uuid=846cc821-b29f-4f7a-b4be-ded0cd02ff40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converting VIF {"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:64:37,bridge_name='br-int',has_traffic_filtering=True,id=6be22d43-be99-4c35-a55a-a35424ce0611,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be22d43-be') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG os_vif [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:64:37,bridge_name='br-int',has_traffic_filtering=True,id=6be22d43-be99-4c35-a55a-a35424ce0611,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be22d43-be') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f034b9f0-e621-564f-9dc7-da719a7c818d', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6be22d43-be, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6be22d43-be, col_values=(('qos', UUID('118e8001-4d3c-4cfa-af2e-a9970285cb94')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6be22d43-be, col_values=(('external_ids', {'iface-id': '6be22d43-be99-4c35-a55a-a35424ce0611', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:64:37', 'vm-uuid': '846cc821-b29f-4f7a-b4be-ded0cd02ff40'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:16 user nova-compute[76161]: INFO os_vif [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:64:37,bridge_name='br-int',has_traffic_filtering=True,id=6be22d43-be99-4c35-a55a-a35424ce0611,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be22d43-be')
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] No VIF found with MAC fa:16:3e:dc:64:37, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-23b71204-7e5c-41f7-b33a-5aafab774fcb req-f58c4dd5-2528-41d4-8d4d-10ca87b938aa service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updated VIF entry in instance network info cache for port 6be22d43-be99-4c35-a55a-a35424ce0611. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-23b71204-7e5c-41f7-b33a-5aafab774fcb req-f58c4dd5-2528-41d4-8d4d-10ca87b938aa service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:20:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-23b71204-7e5c-41f7-b33a-5aafab774fcb req-f58c4dd5-2528-41d4-8d4d-10ca87b938aa service nova] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:20:17 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-0c29d46d-f708-414b-8288-d318499906fd req-b1064f2a-8d7b-4ea0-b48f-79f5531f5981 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:20:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0c29d46d-f708-414b-8288-d318499906fd req-b1064f2a-8d7b-4ea0-b48f-79f5531f5981 service nova] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:20:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0c29d46d-f708-414b-8288-d318499906fd req-b1064f2a-8d7b-4ea0-b48f-79f5531f5981 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:20:18 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-0c29d46d-f708-414b-8288-d318499906fd req-b1064f2a-8d7b-4ea0-b48f-79f5531f5981 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:20:18 user nova-compute[76161]: DEBUG nova.compute.manager [req-0c29d46d-f708-414b-8288-d318499906fd req-b1064f2a-8d7b-4ea0-b48f-79f5531f5981 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] No waiting events found dispatching network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:20:18 user nova-compute[76161]: WARNING nova.compute.manager [req-0c29d46d-f708-414b-8288-d318499906fd req-b1064f2a-8d7b-4ea0-b48f-79f5531f5981 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received unexpected event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 for instance with vm_state building and task_state spawning.
Nov 14 18:20:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:20:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Instance spawned successfully.
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:20:20 user nova-compute[76161]: INFO nova.compute.manager [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.compute.manager [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-b555dffa-b307-4003-8cb7-1cf9c4c3bf22 req-479a98ef-3bfa-4134-94f4-b5c3297b1ca5 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b555dffa-b307-4003-8cb7-1cf9c4c3bf22 req-479a98ef-3bfa-4134-94f4-b5c3297b1ca5 service nova] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b555dffa-b307-4003-8cb7-1cf9c4c3bf22 req-479a98ef-3bfa-4134-94f4-b5c3297b1ca5 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-b555dffa-b307-4003-8cb7-1cf9c4c3bf22 req-479a98ef-3bfa-4134-94f4-b5c3297b1ca5 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-b555dffa-b307-4003-8cb7-1cf9c4c3bf22 req-479a98ef-3bfa-4134-94f4-b5c3297b1ca5 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] No waiting events found dispatching network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:20:20 user nova-compute[76161]: WARNING nova.compute.manager [req-b555dffa-b307-4003-8cb7-1cf9c4c3bf22 req-479a98ef-3bfa-4134-94f4-b5c3297b1ca5 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received unexpected event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 for instance with vm_state building and task_state spawning.
Nov 14 18:20:20 user nova-compute[76161]: INFO nova.compute.manager [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Took 6.48 seconds to build instance.
Nov 14 18:20:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-20e4822f-0723-4f3a-962b-dac329dfc607 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.603s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:20:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:20:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:20:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:20:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:20:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:20:32 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:20:32 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:20:32 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:20:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:20:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:20:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:37 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:38 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:39 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:39 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:20:42 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:20:42 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:20:42 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=25.038211822509766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:20:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing inventories for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating ProviderTree inventory for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing aggregate associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, aggregates: None {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing trait associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:20:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:20:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:20:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 18:20:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] There are 0 instances to clean {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 18:20:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:20:59 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:20:59 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76161) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 18:21:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:21:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:21:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:21:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:21:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:21:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:21:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:21:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:21:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:21:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:21:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:21:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:21:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:21:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:21:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:21:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:21:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:21:32 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:21:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:21:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:21:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:21:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:21:32 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:21:32 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:21:32 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:21:32 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:21:32 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:21:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:21:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:21:39 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:21:39 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:21:39 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:21:41 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:21:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:21:43 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:21:43 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:21:43 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=25.037456512451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:21:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:21:44 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:21:44 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:21:44 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:21:44 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:21:44 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:21:44 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:21:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:21:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:21:46 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:21:46 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:21:46 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:21:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:21:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:21:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:22:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:22:05 user nova-compute[76161]: DEBUG nova.objects.instance [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'flavor' on Instance uuid 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:22:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:22:06 user nova-compute[76161]: INFO nova.compute.manager [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Attaching volume 00ee8e20-835b-4f09-8778-13b001a93555 to /dev/vdb
Nov 14 18:22:06 user nova-compute[76161]: DEBUG os_brick.utils [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[119af27f-ecb1-4ff0-a6cd-93ecf99d8d2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81a1c90-6749-4fe5-ad06-fbf0265904f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e8d05a-b2b8-47a7-a38a-871d1b0d6621]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[10904b3d-b13a-49b9-a3ee-5109e7274201]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:22:06 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:22:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4256c80-e912-41bf-8431-0045b16cc5eb]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG os_brick.utils [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating existing volume attachment record: b50c9b5f-37ea-4b15-b776-30a604dcb94b {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:22:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvYxedtW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:22:10 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:22:10 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:22:10 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[759354a6-9736-41a4-9867-2e2f8d91adb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:22:10 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[479229bf-b92d-4712-a70e-83320b7f195c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555] added
Nov 14 18:22:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[354f26bf-a078-4422-b5cd-49b6b340f58b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f907b7c-288c-4c6d-9b4e-e7f776582606]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DvYxedtW {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DvYxedtW" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f574c7-7514-4b9b-a9b9-d4e3a2a9ae98]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DvYxedtW'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[977ad08a-f0d6-4967-aa0b-e881a88ca5c6]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[28134b94-478b-41a8-b66e-ad3016bee6d4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 18:22:10 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 18:22:10 user nova-compute[76161]:  {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:22:10 user nova-compute[76161]: WARNING os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 18:22:10 user nova-compute[76161]: 
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce515d27-5b2e-4dc6-a2fa-1c84a4b1514c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555, portal: 172.16.0.220,3260]
Nov 14 18:22:10 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555, portal: 172.16.0.220,3260] successful.
Nov 14 18:22:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[351854db-e0cd-446d-b0b2-00da1ceee71a]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[071dc951-4354-49fe-af0e-b6c13378cf47]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 (non-flash)
Nov 14 18:22:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 (non-flash)
Nov 14 18:22:10 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ddd084-9ba7-4178-941a-2fbfba256900]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:22:10 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvYxedtW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:22:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:22:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:22:11 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23461363063356561', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:22:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461363063356561', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:22:11 user nova-compute[76161]: DEBUG nova.objects.instance [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'flavor' on Instance uuid 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:22:11 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:22:11 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:22:11 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:22:11 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:22:11 user nova-compute[76161]:   <serial>00ee8e20-835b-4f09-8778-13b001a93555</serial>
Nov 14 18:22:11 user nova-compute[76161]: </disk>
Nov 14 18:22:11 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:22:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:22:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:22:12 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] No VIF found with MAC fa:16:3e:dc:64:37, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:22:12 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-25cecfc7-c0e3-4337-ab8f-7e7ce8439a32 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.181s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:22:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-ff5dc4ab-ba5e-4935-a4dd-dff71e92e451 req-a40e1d41-785e-46be-b6da-2404c5b0ef92 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-changed-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:22:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-ff5dc4ab-ba5e-4935-a4dd-dff71e92e451 req-a40e1d41-785e-46be-b6da-2404c5b0ef92 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Refreshing instance network info cache due to event network-changed-6be22d43-be99-4c35-a55a-a35424ce0611. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:22:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ff5dc4ab-ba5e-4935-a4dd-dff71e92e451 req-a40e1d41-785e-46be-b6da-2404c5b0ef92 service nova] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:22:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ff5dc4ab-ba5e-4935-a4dd-dff71e92e451 req-a40e1d41-785e-46be-b6da-2404c5b0ef92 service nova] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:22:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-ff5dc4ab-ba5e-4935-a4dd-dff71e92e451 req-a40e1d41-785e-46be-b6da-2404c5b0ef92 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Refreshing network info cache for port 6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:22:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-ff5dc4ab-ba5e-4935-a4dd-dff71e92e451 req-a40e1d41-785e-46be-b6da-2404c5b0ef92 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updated VIF entry in instance network info cache for port 6be22d43-be99-4c35-a55a-a35424ce0611. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:22:14 user nova-compute[76161]: DEBUG nova.network.neutron [req-ff5dc4ab-ba5e-4935-a4dd-dff71e92e451 req-a40e1d41-785e-46be-b6da-2404c5b0ef92 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:22:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-ff5dc4ab-ba5e-4935-a4dd-dff71e92e451 req-a40e1d41-785e-46be-b6da-2404c5b0ef92 service nova] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:22:15 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:16 user nova-compute[76161]: DEBUG nova.compute.manager [req-356e0ee0-a2cc-4ddd-83d9-416e4ac32e42 req-4882e1a3-87b9-4456-9f89-a2df3789bcc1 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-changed-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:22:16 user nova-compute[76161]: DEBUG nova.compute.manager [req-356e0ee0-a2cc-4ddd-83d9-416e4ac32e42 req-4882e1a3-87b9-4456-9f89-a2df3789bcc1 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Refreshing instance network info cache due to event network-changed-6be22d43-be99-4c35-a55a-a35424ce0611. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:22:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-356e0ee0-a2cc-4ddd-83d9-416e4ac32e42 req-4882e1a3-87b9-4456-9f89-a2df3789bcc1 service nova] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:22:16 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-356e0ee0-a2cc-4ddd-83d9-416e4ac32e42 req-4882e1a3-87b9-4456-9f89-a2df3789bcc1 service nova] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:22:16 user nova-compute[76161]: DEBUG nova.network.neutron [req-356e0ee0-a2cc-4ddd-83d9-416e4ac32e42 req-4882e1a3-87b9-4456-9f89-a2df3789bcc1 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Refreshing network info cache for port 6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:22:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-356e0ee0-a2cc-4ddd-83d9-416e4ac32e42 req-4882e1a3-87b9-4456-9f89-a2df3789bcc1 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updated VIF entry in instance network info cache for port 6be22d43-be99-4c35-a55a-a35424ce0611. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:22:17 user nova-compute[76161]: DEBUG nova.network.neutron [req-356e0ee0-a2cc-4ddd-83d9-416e4ac32e42 req-4882e1a3-87b9-4456-9f89-a2df3789bcc1 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:22:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:22:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:22:17 user nova-compute[76161]: INFO nova.compute.manager [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Rebooting instance
Nov 14 18:22:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-356e0ee0-a2cc-4ddd-83d9-416e4ac32e42 req-4882e1a3-87b9-4456-9f89-a2df3789bcc1 service nova] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:22:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:22:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:22:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:22:17 user nova-compute[76161]: DEBUG nova.network.neutron [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:22:17 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:22:17 user nova-compute[76161]: DEBUG nova.compute.manager [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:22:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-8066d6c7-cbf6-44db-9932-2941ebed5ba4 req-10eb1955-3e06-417b-80ed-4cc09e760e16 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-vif-unplugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:22:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8066d6c7-cbf6-44db-9932-2941ebed5ba4 req-10eb1955-3e06-417b-80ed-4cc09e760e16 service nova] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:22:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8066d6c7-cbf6-44db-9932-2941ebed5ba4 req-10eb1955-3e06-417b-80ed-4cc09e760e16 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:22:20 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8066d6c7-cbf6-44db-9932-2941ebed5ba4 req-10eb1955-3e06-417b-80ed-4cc09e760e16 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:22:20 user nova-compute[76161]: DEBUG nova.compute.manager [req-8066d6c7-cbf6-44db-9932-2941ebed5ba4 req-10eb1955-3e06-417b-80ed-4cc09e760e16 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] No waiting events found dispatching network-vif-unplugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:22:20 user nova-compute[76161]: WARNING nova.compute.manager [req-8066d6c7-cbf6-44db-9932-2941ebed5ba4 req-10eb1955-3e06-417b-80ed-4cc09e760e16 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received unexpected event network-vif-unplugged-6be22d43-be99-4c35-a55a-a35424ce0611 for instance with vm_state active and task_state reboot_started.
Nov 14 18:22:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:20 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Instance shutdown successfully.
Nov 14 18:22:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] No waiting events found dispatching network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:22:22 user nova-compute[76161]: WARNING nova.compute.manager [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received unexpected event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 for instance with vm_state active and task_state reboot_started.
Nov 14 18:22:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG nova.compute.manager [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] No waiting events found dispatching network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:22:22 user nova-compute[76161]: WARNING nova.compute.manager [req-54bcb2f6-73d5-4d3b-b96a-4f0b57bad662 req-b9349cbe-0122-4fb1-a121-75a3e7a08398 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received unexpected event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 for instance with vm_state active and task_state reboot_started.
Nov 14 18:22:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:22 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Instance running successfully.
Nov 14 18:22:24 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Instance soft rebooted successfully.
Nov 14 18:22:24 user nova-compute[76161]: DEBUG nova.compute.manager [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:22:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-3f794922-0158-49e9-9d1c-0e3a2badf37e req-69a0bc13-b835-4a07-bcb8-5eeb6d3e5a64 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:22:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f794922-0158-49e9-9d1c-0e3a2badf37e req-69a0bc13-b835-4a07-bcb8-5eeb6d3e5a64 service nova] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:22:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f794922-0158-49e9-9d1c-0e3a2badf37e req-69a0bc13-b835-4a07-bcb8-5eeb6d3e5a64 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:22:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f794922-0158-49e9-9d1c-0e3a2badf37e req-69a0bc13-b835-4a07-bcb8-5eeb6d3e5a64 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:22:24 user nova-compute[76161]: DEBUG nova.compute.manager [req-3f794922-0158-49e9-9d1c-0e3a2badf37e req-69a0bc13-b835-4a07-bcb8-5eeb6d3e5a64 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] No waiting events found dispatching network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:22:24 user nova-compute[76161]: WARNING nova.compute.manager [req-3f794922-0158-49e9-9d1c-0e3a2badf37e req-69a0bc13-b835-4a07-bcb8-5eeb6d3e5a64 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received unexpected event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 for instance with vm_state active and task_state reboot_started.
Nov 14 18:22:24 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-bda185d0-b3ee-45b6-a4db-9bf04585a930 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.166s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:22:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:33 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:22:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:22:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:22:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:22:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:22:33 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:22:33 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:22:33 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:22:33 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:22:33 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:22:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:22:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:39 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:22:39 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:22:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:41 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:22:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:22:44 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:22:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:22:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:22:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:22:44 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:22:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:22:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:22:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:22:44 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:22:44 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:22:44 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=25.027767181396484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:22:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:22:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:22:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:22:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:22:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:22:45 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:22:45 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:22:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:22:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:22:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:47 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:22:47 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:22:47 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:22:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:22:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:23:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:23:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:23:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:23:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:23:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:23:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:23:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:23:34 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:23:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:23:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:23:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:23:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:23:34 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:23:34 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:23:34 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:23:34 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:23:34 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:23:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:23:38 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:23:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:23:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:23:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:23:42 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:23:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76161) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 18:23:44 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:23:44 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:23:44 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.027111053466797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:23:44 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:23:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:23:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:23:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:23:45 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:23:45 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:23:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:23:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:23:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:23:47 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:23:47 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:23:48 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:23:48 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:23:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:23:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-3438e2c7-c3db-479b-8e94-bccb49078e6a req-f837e091-a193-4718-8c2b-624f38f24686 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-changed-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:24:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-3438e2c7-c3db-479b-8e94-bccb49078e6a req-f837e091-a193-4718-8c2b-624f38f24686 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Refreshing instance network info cache due to event network-changed-6be22d43-be99-4c35-a55a-a35424ce0611. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:24:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3438e2c7-c3db-479b-8e94-bccb49078e6a req-f837e091-a193-4718-8c2b-624f38f24686 service nova] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:24:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3438e2c7-c3db-479b-8e94-bccb49078e6a req-f837e091-a193-4718-8c2b-624f38f24686 service nova] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:24:08 user nova-compute[76161]: DEBUG nova.network.neutron [req-3438e2c7-c3db-479b-8e94-bccb49078e6a req-f837e091-a193-4718-8c2b-624f38f24686 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Refreshing network info cache for port 6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.network.neutron [req-3438e2c7-c3db-479b-8e94-bccb49078e6a req-f837e091-a193-4718-8c2b-624f38f24686 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updated VIF entry in instance network info cache for port 6be22d43-be99-4c35-a55a-a35424ce0611. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.network.neutron [req-3438e2c7-c3db-479b-8e94-bccb49078e6a req-f837e091-a193-4718-8c2b-624f38f24686 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3438e2c7-c3db-479b-8e94-bccb49078e6a req-f837e091-a193-4718-8c2b-624f38f24686 service nova] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-8b316afe-7ee2-4fae-8383-f42aa24bf8fa req-8f2e40fa-4dda-4039-9f87-5357e03d2dd2 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-changed-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.compute.manager [req-8b316afe-7ee2-4fae-8383-f42aa24bf8fa req-8f2e40fa-4dda-4039-9f87-5357e03d2dd2 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Refreshing instance network info cache due to event network-changed-6be22d43-be99-4c35-a55a-a35424ce0611. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8b316afe-7ee2-4fae-8383-f42aa24bf8fa req-8f2e40fa-4dda-4039-9f87-5357e03d2dd2 service nova] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8b316afe-7ee2-4fae-8383-f42aa24bf8fa req-8f2e40fa-4dda-4039-9f87-5357e03d2dd2 service nova] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.network.neutron [req-8b316afe-7ee2-4fae-8383-f42aa24bf8fa req-8f2e40fa-4dda-4039-9f87-5357e03d2dd2 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Refreshing network info cache for port 6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:24:09 user nova-compute[76161]: INFO nova.compute.manager [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Detaching volume 00ee8e20-835b-4f09-8778-13b001a93555
Nov 14 18:24:09 user nova-compute[76161]: INFO nova.virt.block_device [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Attempting to driver detach volume 00ee8e20-835b-4f09-8778-13b001a93555 from mountpoint /dev/vdb
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Attempting to detach device vdb from instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:24:09 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:24:09 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:24:09 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:24:09 user nova-compute[76161]:   <serial>00ee8e20-835b-4f09-8778-13b001a93555</serial>
Nov 14 18:24:09 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:24:09 user nova-compute[76161]: </disk>
Nov 14 18:24:09 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:24:09 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Successfully detached device vdb from instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 from the persistent domain config.
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:24:09 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:24:09 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:24:09 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:24:09 user nova-compute[76161]:   <serial>00ee8e20-835b-4f09-8778-13b001a93555</serial>
Nov 14 18:24:09 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:24:09 user nova-compute[76161]: </disk>
Nov 14 18:24:09 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.network.neutron [req-8b316afe-7ee2-4fae-8383-f42aa24bf8fa req-8f2e40fa-4dda-4039-9f87-5357e03d2dd2 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updated VIF entry in instance network info cache for port 6be22d43-be99-4c35-a55a-a35424ce0611. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG nova.network.neutron [req-8b316afe-7ee2-4fae-8383-f42aa24bf8fa req-8f2e40fa-4dda-4039-9f87-5357e03d2dd2 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:24:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-8b316afe-7ee2-4fae-8383-f42aa24bf8fa req-8f2e40fa-4dda-4039-9f87-5357e03d2dd2 service nova] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:24:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:24:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:16 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:21 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:30 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 is timed out.
Nov 14 18:24:30 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Successfully detached device vdb from instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 from the live domain config.
Nov 14 18:24:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DvYxedtW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:24:30 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9964d9-f772-4bdc-a349-1d5523ef658b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:24:30 user nova-compute[76161]: No targets found.
Nov 14 18:24:30 user nova-compute[76161]: iSNS:
Nov 14 18:24:30 user nova-compute[76161]: No targets found.
Nov 14 18:24:30 user nova-compute[76161]: STATIC:
Nov 14 18:24:30 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555
Nov 14 18:24:30 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:24:30 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:24:30 user nova-compute[76161]: FIRMWARE:
Nov 14 18:24:30 user nova-compute[76161]: No targets found.
Nov 14 18:24:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:24:30 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:24:30 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41ad11a-3852-4082-a477-940757fa0483]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf507a30-4b46-4d3c-a115-36b7d4eee865]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 (non-flash)
Nov 14 18:24:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 (non-flash)
Nov 14 18:24:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4d0653760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[449f5cd5-920e-46e9-a318-b7637b466829]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[27999dea-1041-4f94-b6fd-5dfb4dd78557]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf64e2c-54b1-4954-a893-46e45ae9b4f7]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ebdac1-f402-4d3c-bc4e-b1d923001aaf]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8524897c-7d1e-4413-896b-377a1cad27f4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b59b67-703c-484b-be54-eeee3076f695]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555, portal: 172.16.0.220,3260]
Nov 14 18:24:30 user nova-compute[76161]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555, portal: 172.16.0.220,3260] successful.
Nov 14 18:24:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00ee8e20-835b-4f09-8778-13b001a93555 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26439cb-4e8e-4f06-800f-e1eab4771d7e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] <== disconnect_volume: return (285ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:24:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:24:31 user nova-compute[76161]: DEBUG nova.objects.instance [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'flavor' on Instance uuid 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:24:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-c9d8c5f2-44b9-4bf4-b530-8322e7a1f945 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.601s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:24:31 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [{"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-846cc821-b29f-4f7a-b4be-ded0cd02ff40" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:24:36 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:38 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:24:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:24:41 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:24:41 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:24:44 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:24:45 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:24:45 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:24:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=25.026336669921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:24:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:24:46 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:24:46 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:24:46 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:24:46 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:24:46 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:24:46 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:24:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:24:46 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:49 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:24:49 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:24:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:24:51 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:24:56 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:25:02 user nova-compute[76161]: INFO nova.compute.manager [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Terminating instance
Nov 14 18:25:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-dfd439f5-e90a-480d-8d2a-2ac1afa11144 req-367abfc1-19f8-4376-8a30-fd7d3f775894 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-vif-unplugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dfd439f5-e90a-480d-8d2a-2ac1afa11144 req-367abfc1-19f8-4376-8a30-fd7d3f775894 service nova] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dfd439f5-e90a-480d-8d2a-2ac1afa11144 req-367abfc1-19f8-4376-8a30-fd7d3f775894 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-dfd439f5-e90a-480d-8d2a-2ac1afa11144 req-367abfc1-19f8-4376-8a30-fd7d3f775894 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-dfd439f5-e90a-480d-8d2a-2ac1afa11144 req-367abfc1-19f8-4376-8a30-fd7d3f775894 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] No waiting events found dispatching network-vif-unplugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:25:02 user nova-compute[76161]: DEBUG nova.compute.manager [req-dfd439f5-e90a-480d-8d2a-2ac1afa11144 req-367abfc1-19f8-4376-8a30-fd7d3f775894 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-vif-unplugged-6be22d43-be99-4c35-a55a-a35424ce0611 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:25:02 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Instance destroyed successfully.
Nov 14 18:25:02 user nova-compute[76161]: DEBUG nova.objects.instance [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lazy-loading 'resources' on Instance uuid 846cc821-b29f-4f7a-b4be-ded0cd02ff40 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1627430512',display_name='tempest-TestMinimumBasicScenario-server-1627430512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1627430512',id=52,image_ref='24441554-b774-4a0b-85d8-6468d7886142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAJnNb6JUcj9utG1QT7lNDUly56ay6g2zMsKL1wyE6xsg5ys37JGLcThcKh4qqR4QTkNJbIaHg5wLkbO1R2FcMmW+VXGtXCz82RJ6YSz+SrgIB76yllEeC+5WBu7AXH9w==',key_name='tempest-TestMinimumBasicScenario-576597934',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:20:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83e313849c0b452e9dd6f5afd4006e31',ramdisk_id='',reservation_id='r-d93iyd8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='24441554-b774-4a0b-85d8-6468d7886142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-451246924',owner_user_name='tempest-TestMinimumBasicScenario-451246924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:22:24Z,user_data=None,user_id='fcb6dc8c680145809756f79ccc78ead8',uuid=846cc821-b29f-4f7a-b4be-ded0cd02ff40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converting VIF {"id": "6be22d43-be99-4c35-a55a-a35424ce0611", "address": "fa:16:3e:dc:64:37", "network": {"id": "4b0cee9b-0a95-4289-a877-b7f96a5326d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-148563623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83e313849c0b452e9dd6f5afd4006e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be22d43-be", "ovs_interfaceid": "6be22d43-be99-4c35-a55a-a35424ce0611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:64:37,bridge_name='br-int',has_traffic_filtering=True,id=6be22d43-be99-4c35-a55a-a35424ce0611,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be22d43-be') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG os_vif [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:64:37,bridge_name='br-int',has_traffic_filtering=True,id=6be22d43-be99-4c35-a55a-a35424ce0611,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be22d43-be') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6be22d43-be, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=118e8001-4d3c-4cfa-af2e-a9970285cb94) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:03 user nova-compute[76161]: INFO os_vif [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:64:37,bridge_name='br-int',has_traffic_filtering=True,id=6be22d43-be99-4c35-a55a-a35424ce0611,network=Network(4b0cee9b-0a95-4289-a877-b7f96a5326d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be22d43-be')
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Deleting instance files /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40_del
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Deletion of /opt/stack/data/nova/instances/846cc821-b29f-4f7a-b4be-ded0cd02ff40_del complete
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.compute.manager [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Verify base images {{(pid=76161) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Image id 24441554-b774-4a0b-85d8-6468d7886142 yields fingerprint 3103be68c4e2625837bad5e756a5c21a5677ade9 {{(pid=76161) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] image 24441554-b774-4a0b-85d8-6468d7886142 at (/opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9): checking
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] image 24441554-b774-4a0b-85d8-6468d7886142 at (/opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9): image is in use {{(pid=76161) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=76161) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 18:25:03 user nova-compute[76161]: WARNING nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Unknown base file: /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671
Nov 14 18:25:03 user nova-compute[76161]: WARNING nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Unknown base file: /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448
Nov 14 18:25:03 user nova-compute[76161]: WARNING nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce
Nov 14 18:25:03 user nova-compute[76161]: WARNING nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb
Nov 14 18:25:03 user nova-compute[76161]: WARNING nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Unknown base file: /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120
Nov 14 18:25:03 user nova-compute[76161]: WARNING nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d
Nov 14 18:25:03 user nova-compute[76161]: WARNING nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Unknown base file: /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b
Nov 14 18:25:03 user nova-compute[76161]: WARNING nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473
Nov 14 18:25:03 user nova-compute[76161]: WARNING nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Active base files: /opt/stack/data/nova/instances/_base/3103be68c4e2625837bad5e756a5c21a5677ade9
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Removable base files: /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671 /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448 /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120 /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473 /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/64ebdec4384415961f35d07d850268a05aeb2671
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/31faef246a4fa94a17bba09ae19bdf70ce269448
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1bceeb53f3355bcdf671c48aeb3b36b0d522f1ce
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d1a83d34f165620890575882711aec7ee83b87fb
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/64682f6acfaa0d17122f6685446b745bbf545120
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/10e3d6be43f11361823f88a52e42a296b28bab6b
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5921006b6b6cb56100d3cac40fb892c5d6b85473
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8de566d15c6f074d1a2edd2f1124e3a28e70207a
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Verification complete {{(pid=76161) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Verify swap images {{(pid=76161) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.virt.libvirt.imagecache [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Verify ephemeral images {{(pid=76161) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Took 0.44 seconds to deallocate network for instance.
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:25:03 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Deleted allocations for instance 846cc821-b29f-4f7a-b4be-ded0cd02ff40
Nov 14 18:25:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-9e9ae643-2393-4edd-9a2a-0748a0eb2970 tempest-TestMinimumBasicScenario-451246924 tempest-TestMinimumBasicScenario-451246924-project-member] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.717s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:25:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-84bba7a3-9bac-44f5-8527-74fc405275c8 req-0d1977fc-0d23-4774-82c5-bb96a7f57784 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:25:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-84bba7a3-9bac-44f5-8527-74fc405275c8 req-0d1977fc-0d23-4774-82c5-bb96a7f57784 service nova] Acquiring lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:25:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-84bba7a3-9bac-44f5-8527-74fc405275c8 req-0d1977fc-0d23-4774-82c5-bb96a7f57784 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:25:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-84bba7a3-9bac-44f5-8527-74fc405275c8 req-0d1977fc-0d23-4774-82c5-bb96a7f57784 service nova] Lock "846cc821-b29f-4f7a-b4be-ded0cd02ff40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:25:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-84bba7a3-9bac-44f5-8527-74fc405275c8 req-0d1977fc-0d23-4774-82c5-bb96a7f57784 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] No waiting events found dispatching network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:25:04 user nova-compute[76161]: WARNING nova.compute.manager [req-84bba7a3-9bac-44f5-8527-74fc405275c8 req-0d1977fc-0d23-4774-82c5-bb96a7f57784 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received unexpected event network-vif-plugged-6be22d43-be99-4c35-a55a-a35424ce0611 for instance with vm_state deleted and task_state None.
Nov 14 18:25:04 user nova-compute[76161]: DEBUG nova.compute.manager [req-84bba7a3-9bac-44f5-8527-74fc405275c8 req-0d1977fc-0d23-4774-82c5-bb96a7f57784 service nova] [instance: 846cc821-b29f-4f7a-b4be-ded0cd02ff40] Received event network-vif-deleted-6be22d43-be99-4c35-a55a-a35424ce0611 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:25:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:25:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:37 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:25:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:25:37 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 18:25:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:25:38 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:42 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:25:44 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:25:45 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:25:45 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=9140MB free_disk=25.053714752197266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing inventories for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating ProviderTree inventory for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing aggregate associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, aggregates: None {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing trait associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:25:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:25:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:25:49 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:25:49 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:50 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:50 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:55 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:25:55 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 18:25:55 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] There are 0 instances to clean {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 18:25:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:25:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:02 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:02 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76161) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 18:26:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:26:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:26:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:26:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:26:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:08 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:11 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_power_states {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:26:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:26:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:26:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:26:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:26:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:26:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:26:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:26:39 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:39 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:26:39 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:26:39 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 18:26:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:42 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:26:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:26:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:26:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:26:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:45 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:26:46 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:26:46 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:26:46 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=25.088756561279297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:26:46 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:26:47 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:26:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:26:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:48 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:50 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:50 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:26:50 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:26:52 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:53 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:26:58 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:27:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:27:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Starting instance... {{(pid=76161) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 18:27:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:27:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:27:00 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76161) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 18:27:00 user nova-compute[76161]: INFO nova.compute.claims [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Claim successful on node user
Nov 14 18:27:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Start building networks asynchronously for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Allocating IP information in the background. {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] allocate_for_instance() {{(pid=76161) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 18:27:01 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 18:27:01 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Start building block device mappings for instance. {{(pid=76161) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG nova.policy [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29dc4b1bef4d4b27928ec73402fcbd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1ba630cb0d4725af03a93945f39596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76161) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Start spawning the instance on the hypervisor. {{(pid=76161) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Creating instance directory {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 18:27:01 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Creating image(s)
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "/opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "/opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "/opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.222s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.203s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk 1073741824 {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d,backing_fmt=raw /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk 1073741824" returned: 0 in 0.095s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "b9c371cab2c5ee29bebbbe93d30dba575ec88f8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:27:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:27:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9c371cab2c5ee29bebbbe93d30dba575ec88f8d --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:27:02 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk. size=1073741824 {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 18:27:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:27:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:27:02 user nova-compute[76161]: DEBUG nova.virt.disk.api [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Cannot resize image /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk to a smaller size. {{(pid=76161) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 18:27:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Created local disks {{(pid=76161) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 18:27:02 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Ensure instance console log exists: /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/console.log {{(pid=76161) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 18:27:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:27:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:27:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:27:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:03 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Successfully created port: babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 18:27:03 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Successfully updated port: babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 18:27:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:27:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquired lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:27:03 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Building network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 18:27:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-678911f1-d75f-4d9e-b84f-b13f35409bc9 req-77630aa1-8197-49eb-a7ad-2a53e2ef08a2 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received event network-changed-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:27:03 user nova-compute[76161]: DEBUG nova.compute.manager [req-678911f1-d75f-4d9e-b84f-b13f35409bc9 req-77630aa1-8197-49eb-a7ad-2a53e2ef08a2 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Refreshing instance network info cache due to event network-changed-babe43bc-e2f2-44b9-a39d-1d5127371584. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:27:03 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-678911f1-d75f-4d9e-b84f-b13f35409bc9 req-77630aa1-8197-49eb-a7ad-2a53e2ef08a2 service nova] Acquiring lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Instance cache missing network info. {{(pid=76161) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.network.neutron [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating instance_info_cache with network_info: [{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Releasing lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Instance network_info: |[{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76161) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-678911f1-d75f-4d9e-b84f-b13f35409bc9 req-77630aa1-8197-49eb-a7ad-2a53e2ef08a2 service nova] Acquired lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.network.neutron [req-678911f1-d75f-4d9e-b84f-b13f35409bc9 req-77630aa1-8197-49eb-a7ad-2a53e2ef08a2 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Refreshing network info cache for port babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Start _get_guest_xml network_info=[{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '1804ef46-1f05-4c8f-910b-8e52c7b69935'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 18:27:04 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:27:04 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] CPU controller missing on host. {{(pid=76161) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.host [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] CPU controller found on host. {{(pid=76161) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76161) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T17:45:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T17:45:31Z,direct_url=<?>,disk_format='qcow2',id=1804ef46-1f05-4c8f-910b-8e52c7b69935,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5959f76ddcb0476184d4947075ac629a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T17:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Flavor limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Image limits 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Flavor pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Image pref 0:0:0 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Got 1 possible topologies {{(pid=76161) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.hardware [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76161) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-964003529',display_name='tempest-SnapshotDataIntegrityTests-server-964003529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-964003529',id=53,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCs3iUswbooz7iCb2hdnlRW8JehcuOjhTWHBoJnbZaCjw+B8k4y6DZThdK3ji8taWeGLiC9iIwt/P4Jac8tajBENvoT3VQtWxq1AQbjKdBJcR6WRT29a6N5XTG0/sRnLQ==',key_name='tempest-keypair-1396118114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa1ba630cb0d4725af03a93945f39596',ramdisk_id='',reservation_id='r-o7yucncr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-703268280',owner_user_name='tempest-SnapshotDataIntegrityTests-703268280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29dc4b1bef4d4b27928ec73402fcbd7e',uuid=924c630f-5712-4eed-a9fb-ec6850979887,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76161) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Converting VIF {"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:14:16,bridge_name='br-int',has_traffic_filtering=True,id=babe43bc-e2f2-44b9-a39d-1d5127371584,network=Network(f323a08f-29bc-4415-ad2c-d85e64e7770c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabe43bc-e2') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.objects.instance [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'pci_devices' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] End _get_guest_xml xml=<domain type="kvm">
Nov 14 18:27:04 user nova-compute[76161]:   <uuid>924c630f-5712-4eed-a9fb-ec6850979887</uuid>
Nov 14 18:27:04 user nova-compute[76161]:   <name>instance-00000035</name>
Nov 14 18:27:04 user nova-compute[76161]:   <memory>524288</memory>
Nov 14 18:27:04 user nova-compute[76161]:   <vcpu>1</vcpu>
Nov 14 18:27:04 user nova-compute[76161]:   <metadata>
Nov 14 18:27:04 user nova-compute[76161]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 18:27:04 user nova-compute[76161]:       <nova:package version="0.0.0"/>
Nov 14 18:27:04 user nova-compute[76161]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-964003529</nova:name>
Nov 14 18:27:04 user nova-compute[76161]:       <nova:creationTime>2023-11-14 18:27:04</nova:creationTime>
Nov 14 18:27:04 user nova-compute[76161]:       <nova:flavor name="m1.tiny">
Nov 14 18:27:04 user nova-compute[76161]:         <nova:memory>512</nova:memory>
Nov 14 18:27:04 user nova-compute[76161]:         <nova:disk>1</nova:disk>
Nov 14 18:27:04 user nova-compute[76161]:         <nova:swap>0</nova:swap>
Nov 14 18:27:04 user nova-compute[76161]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 18:27:04 user nova-compute[76161]:         <nova:vcpus>1</nova:vcpus>
Nov 14 18:27:04 user nova-compute[76161]:       </nova:flavor>
Nov 14 18:27:04 user nova-compute[76161]:       <nova:owner>
Nov 14 18:27:04 user nova-compute[76161]:         <nova:user uuid="29dc4b1bef4d4b27928ec73402fcbd7e">tempest-SnapshotDataIntegrityTests-703268280-project-member</nova:user>
Nov 14 18:27:04 user nova-compute[76161]:         <nova:project uuid="fa1ba630cb0d4725af03a93945f39596">tempest-SnapshotDataIntegrityTests-703268280</nova:project>
Nov 14 18:27:04 user nova-compute[76161]:       </nova:owner>
Nov 14 18:27:04 user nova-compute[76161]:       <nova:root type="image" uuid="1804ef46-1f05-4c8f-910b-8e52c7b69935"/>
Nov 14 18:27:04 user nova-compute[76161]:       <nova:ports>
Nov 14 18:27:04 user nova-compute[76161]:         <nova:port uuid="babe43bc-e2f2-44b9-a39d-1d5127371584">
Nov 14 18:27:04 user nova-compute[76161]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 18:27:04 user nova-compute[76161]:         </nova:port>
Nov 14 18:27:04 user nova-compute[76161]:       </nova:ports>
Nov 14 18:27:04 user nova-compute[76161]:     </nova:instance>
Nov 14 18:27:04 user nova-compute[76161]:   </metadata>
Nov 14 18:27:04 user nova-compute[76161]:   <sysinfo type="smbios">
Nov 14 18:27:04 user nova-compute[76161]:     <system>
Nov 14 18:27:04 user nova-compute[76161]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 18:27:04 user nova-compute[76161]:       <entry name="product">OpenStack Nova</entry>
Nov 14 18:27:04 user nova-compute[76161]:       <entry name="version">0.0.0</entry>
Nov 14 18:27:04 user nova-compute[76161]:       <entry name="serial">924c630f-5712-4eed-a9fb-ec6850979887</entry>
Nov 14 18:27:04 user nova-compute[76161]:       <entry name="uuid">924c630f-5712-4eed-a9fb-ec6850979887</entry>
Nov 14 18:27:04 user nova-compute[76161]:       <entry name="family">Virtual Machine</entry>
Nov 14 18:27:04 user nova-compute[76161]:     </system>
Nov 14 18:27:04 user nova-compute[76161]:   </sysinfo>
Nov 14 18:27:04 user nova-compute[76161]:   <os>
Nov 14 18:27:04 user nova-compute[76161]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 18:27:04 user nova-compute[76161]:     <boot dev="hd"/>
Nov 14 18:27:04 user nova-compute[76161]:     <smbios mode="sysinfo"/>
Nov 14 18:27:04 user nova-compute[76161]:   </os>
Nov 14 18:27:04 user nova-compute[76161]:   <features>
Nov 14 18:27:04 user nova-compute[76161]:     <acpi/>
Nov 14 18:27:04 user nova-compute[76161]:     <apic/>
Nov 14 18:27:04 user nova-compute[76161]:     <vmcoreinfo/>
Nov 14 18:27:04 user nova-compute[76161]:   </features>
Nov 14 18:27:04 user nova-compute[76161]:   <clock offset="utc">
Nov 14 18:27:04 user nova-compute[76161]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 18:27:04 user nova-compute[76161]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 18:27:04 user nova-compute[76161]:     <timer name="hpet" present="no"/>
Nov 14 18:27:04 user nova-compute[76161]:   </clock>
Nov 14 18:27:04 user nova-compute[76161]:   <cpu mode="custom" match="exact">
Nov 14 18:27:04 user nova-compute[76161]:     <model>Nehalem</model>
Nov 14 18:27:04 user nova-compute[76161]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 18:27:04 user nova-compute[76161]:   </cpu>
Nov 14 18:27:04 user nova-compute[76161]:   <devices>
Nov 14 18:27:04 user nova-compute[76161]:     <disk type="file" device="disk">
Nov 14 18:27:04 user nova-compute[76161]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 18:27:04 user nova-compute[76161]:       <source file="/opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk"/>
Nov 14 18:27:04 user nova-compute[76161]:       <target dev="vda" bus="virtio"/>
Nov 14 18:27:04 user nova-compute[76161]:     </disk>
Nov 14 18:27:04 user nova-compute[76161]:     <interface type="ethernet">
Nov 14 18:27:04 user nova-compute[76161]:       <mac address="fa:16:3e:f9:14:16"/>
Nov 14 18:27:04 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:27:04 user nova-compute[76161]:       <mtu size="1442"/>
Nov 14 18:27:04 user nova-compute[76161]:       <target dev="tapbabe43bc-e2"/>
Nov 14 18:27:04 user nova-compute[76161]:     </interface>
Nov 14 18:27:04 user nova-compute[76161]:     <serial type="pty">
Nov 14 18:27:04 user nova-compute[76161]:       <log file="/opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/console.log" append="off"/>
Nov 14 18:27:04 user nova-compute[76161]:     </serial>
Nov 14 18:27:04 user nova-compute[76161]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 18:27:04 user nova-compute[76161]:     <video>
Nov 14 18:27:04 user nova-compute[76161]:       <model type="virtio"/>
Nov 14 18:27:04 user nova-compute[76161]:     </video>
Nov 14 18:27:04 user nova-compute[76161]:     <rng model="virtio">
Nov 14 18:27:04 user nova-compute[76161]:       <backend model="random">/dev/urandom</backend>
Nov 14 18:27:04 user nova-compute[76161]:     </rng>
Nov 14 18:27:04 user nova-compute[76161]:     <controller type="usb" index="0" model="none"/>
Nov 14 18:27:04 user nova-compute[76161]:     <memballoon model="virtio">
Nov 14 18:27:04 user nova-compute[76161]:       <stats period="10"/>
Nov 14 18:27:04 user nova-compute[76161]:     </memballoon>
Nov 14 18:27:04 user nova-compute[76161]:   </devices>
Nov 14 18:27:04 user nova-compute[76161]: </domain>
Nov 14 18:27:04 user nova-compute[76161]:  {{(pid=76161) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-964003529',display_name='tempest-SnapshotDataIntegrityTests-server-964003529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-964003529',id=53,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCs3iUswbooz7iCb2hdnlRW8JehcuOjhTWHBoJnbZaCjw+B8k4y6DZThdK3ji8taWeGLiC9iIwt/P4Jac8tajBENvoT3VQtWxq1AQbjKdBJcR6WRT29a6N5XTG0/sRnLQ==',key_name='tempest-keypair-1396118114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa1ba630cb0d4725af03a93945f39596',ramdisk_id='',reservation_id='r-o7yucncr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-703268280',owner_user_name='tempest-SnapshotDataIntegrityTests-703268280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T18:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29dc4b1bef4d4b27928ec73402fcbd7e',uuid=924c630f-5712-4eed-a9fb-ec6850979887,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Converting VIF {"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:14:16,bridge_name='br-int',has_traffic_filtering=True,id=babe43bc-e2f2-44b9-a39d-1d5127371584,network=Network(f323a08f-29bc-4415-ad2c-d85e64e7770c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabe43bc-e2') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG os_vif [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:14:16,bridge_name='br-int',has_traffic_filtering=True,id=babe43bc-e2f2-44b9-a39d-1d5127371584,network=Network(f323a08f-29bc-4415-ad2c-d85e64e7770c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabe43bc-e2') {{(pid=76161) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b93882c-ac32-5a0f-abc8-52ddae6dfa44', '_type': 'linux-noop'}}, row=False) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbabe43bc-e2, may_exist=True, interface_attrs={}) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbabe43bc-e2, col_values=(('qos', UUID('ea00c7fe-4e66-465b-934f-7e8fdd19daf1')),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbabe43bc-e2, col_values=(('external_ids', {'iface-id': 'babe43bc-e2f2-44b9-a39d-1d5127371584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:14:16', 'vm-uuid': '924c630f-5712-4eed-a9fb-ec6850979887'}),), if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:04 user nova-compute[76161]: INFO os_vif [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:14:16,bridge_name='br-int',has_traffic_filtering=True,id=babe43bc-e2f2-44b9-a39d-1d5127371584,network=Network(f323a08f-29bc-4415-ad2c-d85e64e7770c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabe43bc-e2')
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:27:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No VIF found with MAC fa:16:3e:f9:14:16, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:27:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-678911f1-d75f-4d9e-b84f-b13f35409bc9 req-77630aa1-8197-49eb-a7ad-2a53e2ef08a2 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updated VIF entry in instance network info cache for port babe43bc-e2f2-44b9-a39d-1d5127371584. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:27:05 user nova-compute[76161]: DEBUG nova.network.neutron [req-678911f1-d75f-4d9e-b84f-b13f35409bc9 req-77630aa1-8197-49eb-a7ad-2a53e2ef08a2 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating instance_info_cache with network_info: [{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:27:05 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-678911f1-d75f-4d9e-b84f-b13f35409bc9 req-77630aa1-8197-49eb-a7ad-2a53e2ef08a2 service nova] Releasing lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:27:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-c25de380-a642-4788-91cd-69f32bc77a66 req-e4cead6f-b606-49d4-a147-d2c83e824e82 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received event network-vif-plugged-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:27:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c25de380-a642-4788-91cd-69f32bc77a66 req-e4cead6f-b606-49d4-a147-d2c83e824e82 service nova] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:27:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c25de380-a642-4788-91cd-69f32bc77a66 req-e4cead6f-b606-49d4-a147-d2c83e824e82 service nova] Lock "924c630f-5712-4eed-a9fb-ec6850979887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:27:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-c25de380-a642-4788-91cd-69f32bc77a66 req-e4cead6f-b606-49d4-a147-d2c83e824e82 service nova] Lock "924c630f-5712-4eed-a9fb-ec6850979887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:27:06 user nova-compute[76161]: DEBUG nova.compute.manager [req-c25de380-a642-4788-91cd-69f32bc77a66 req-e4cead6f-b606-49d4-a147-d2c83e824e82 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] No waiting events found dispatching network-vif-plugged-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:27:06 user nova-compute[76161]: WARNING nova.compute.manager [req-c25de380-a642-4788-91cd-69f32bc77a66 req-e4cead6f-b606-49d4-a147-d2c83e824e82 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received unexpected event network-vif-plugged-babe43bc-e2f2-44b9-a39d-1d5127371584 for instance with vm_state building and task_state spawning.
Nov 14 18:27:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-3f73730f-cf4d-40c2-853a-da4ce95de705 req-7be57bfe-9f75-4b8b-8b93-c448e9e33ca7 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received event network-vif-plugged-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f73730f-cf4d-40c2-853a-da4ce95de705 req-7be57bfe-9f75-4b8b-8b93-c448e9e33ca7 service nova] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f73730f-cf4d-40c2-853a-da4ce95de705 req-7be57bfe-9f75-4b8b-8b93-c448e9e33ca7 service nova] Lock "924c630f-5712-4eed-a9fb-ec6850979887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-3f73730f-cf4d-40c2-853a-da4ce95de705 req-7be57bfe-9f75-4b8b-8b93-c448e9e33ca7 service nova] Lock "924c630f-5712-4eed-a9fb-ec6850979887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.compute.manager [req-3f73730f-cf4d-40c2-853a-da4ce95de705 req-7be57bfe-9f75-4b8b-8b93-c448e9e33ca7 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] No waiting events found dispatching network-vif-plugged-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:27:08 user nova-compute[76161]: WARNING nova.compute.manager [req-3f73730f-cf4d-40c2-853a-da4ce95de705 req-7be57bfe-9f75-4b8b-8b93-c448e9e33ca7 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received unexpected event network-vif-plugged-babe43bc-e2f2-44b9-a39d-1d5127371584 for instance with vm_state building and task_state spawning.
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Instance event wait completed in 0 seconds for  {{(pid=76161) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Guest created on hypervisor {{(pid=76161) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 18:27:08 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Instance spawned successfully.
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Found default for hw_cdrom_bus of ide {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Found default for hw_disk_bus of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Found default for hw_input_bus of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Found default for hw_pointer_model of None {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Found default for hw_video_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Found default for hw_vif_model of virtio {{(pid=76161) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 18:27:08 user nova-compute[76161]: INFO nova.compute.manager [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Took 7.15 seconds to spawn the instance on the hypervisor.
Nov 14 18:27:08 user nova-compute[76161]: DEBUG nova.compute.manager [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Checking state {{(pid=76161) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 18:27:08 user nova-compute[76161]: INFO nova.compute.manager [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Took 7.83 seconds to build instance.
Nov 14 18:27:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-6ae9e02c-a9a3-4bba-aeb8-bd0b4c780d6d tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.975s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:27:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:27:20 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:25 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:30 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:35 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating instance_info_cache with network_info: [{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:27:40 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:41 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:27:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:27:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:27:46 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:27:47 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:27:48 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:27:48 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:27:48 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8942MB free_disk=25.047595977783203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:27:48 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:27:49 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 924c630f-5712-4eed-a9fb-ec6850979887 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:27:49 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:27:49 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:27:49 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:27:49 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:27:49 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:27:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:27:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:27:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:27:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:27:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:27:53 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:27:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:27:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:28:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:28:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:28:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:28:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating instance_info_cache with network_info: [{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:28:42 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:28:44 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:28:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:28:47 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:49 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:28:49 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:28:49 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=25.047035217285156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:28:49 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:28:50 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 924c630f-5712-4eed-a9fb-ec6850979887 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:28:50 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:28:50 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:28:50 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:28:50 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:28:50 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:28:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:28:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:28:51 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:28:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-aa1dea4f-b5ad-4dc4-bc7b-deb44bee5bb2 req-23b9cf73-63d4-42e2-aaed-0db2c4c4f8f9 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received event network-changed-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:28:51 user nova-compute[76161]: DEBUG nova.compute.manager [req-aa1dea4f-b5ad-4dc4-bc7b-deb44bee5bb2 req-23b9cf73-63d4-42e2-aaed-0db2c4c4f8f9 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Refreshing instance network info cache due to event network-changed-babe43bc-e2f2-44b9-a39d-1d5127371584. {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 18:28:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aa1dea4f-b5ad-4dc4-bc7b-deb44bee5bb2 req-23b9cf73-63d4-42e2-aaed-0db2c4c4f8f9 service nova] Acquiring lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:28:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aa1dea4f-b5ad-4dc4-bc7b-deb44bee5bb2 req-23b9cf73-63d4-42e2-aaed-0db2c4c4f8f9 service nova] Acquired lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:28:51 user nova-compute[76161]: DEBUG nova.network.neutron [req-aa1dea4f-b5ad-4dc4-bc7b-deb44bee5bb2 req-23b9cf73-63d4-42e2-aaed-0db2c4c4f8f9 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Refreshing network info cache for port babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 18:28:52 user nova-compute[76161]: DEBUG nova.network.neutron [req-aa1dea4f-b5ad-4dc4-bc7b-deb44bee5bb2 req-23b9cf73-63d4-42e2-aaed-0db2c4c4f8f9 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updated VIF entry in instance network info cache for port babe43bc-e2f2-44b9-a39d-1d5127371584. {{(pid=76161) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 18:28:52 user nova-compute[76161]: DEBUG nova.network.neutron [req-aa1dea4f-b5ad-4dc4-bc7b-deb44bee5bb2 req-23b9cf73-63d4-42e2-aaed-0db2c4c4f8f9 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating instance_info_cache with network_info: [{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:28:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-aa1dea4f-b5ad-4dc4-bc7b-deb44bee5bb2 req-23b9cf73-63d4-42e2-aaed-0db2c4c4f8f9 service nova] Releasing lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:28:54 user nova-compute[76161]: INFO nova.compute.manager [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attaching volume 25a08da0-5af3-4876-9f23-82012aec5f9c to /dev/vdb
Nov 14 18:28:54 user nova-compute[76161]: DEBUG os_brick.utils [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e752bce-b60e-427d-9f98-f6659c54a106]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2920ca5d-0641-42ef-9ad9-2e18479037ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f525f6b-6e24-4db0-af9e-cba522fce56e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6963d13-43ed-4df8-8b86-6df32ee8ab4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:28:54 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:28:54 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c331cf52-eac0-47b2-9d5a-76f1a1c698d3]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG os_brick.utils [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:28:54 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating existing volume attachment record: 72f0b937-c2a4-4efe-9d89-e99603d6ecf0 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:28:55 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:28:55 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCOAdztg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:28:58 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:28:58 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:28:58 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aa5de4-4775-4b05-a09c-e3455fcee942]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:28:58 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbc9019-dc50-4c43-8492-aaf18b415985]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c] added
Nov 14 18:28:58 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[81691b3e-6218-4cd6-9d4d-961b0ac875fc]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2708dd-ae99-46a1-9065-7c96633bc819]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCOAdztg {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCOAdztg" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a4bac0-9264-47f0-9ad1-d8f3e4b1a5fe]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RCOAdztg'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[068c908f-e659-4188-a1df-1fcb727c7916]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a70960-e229-4c4f-8863-80bbe212451f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 18:28:58 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:28:58 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 18:28:58 user nova-compute[76161]:  {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:28:58 user nova-compute[76161]: WARNING os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 18:28:58 user nova-compute[76161]: 
Nov 14 18:28:58 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba6b8f0-910d-497c-9458-d3db130735d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c, portal: 172.16.0.220,3260]
Nov 14 18:28:59 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c, portal: 172.16.0.220,3260] successful.
Nov 14 18:28:59 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6febcc-4f4b-4551-9374-ec6df1a7cc1d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad69c9-0c3c-487e-a26a-cbf7a3e5b107]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c (non-flash)
Nov 14 18:28:59 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c (non-flash)
Nov 14 18:28:59 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[853f5c77-3949-416d-a505-43be2bae220a]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCOAdztg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:28:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:29:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23432376264633764', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:29:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432376264633764', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:29:00 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:29:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:29:00 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:29:00 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:29:00 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:29:00 user nova-compute[76161]:   <serial>25a08da0-5af3-4876-9f23-82012aec5f9c</serial>
Nov 14 18:29:00 user nova-compute[76161]: </disk>
Nov 14 18:29:00 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:29:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:29:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:29:00 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No VIF found with MAC fa:16:3e:f9:14:16, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:29:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d369a9fe-f71a-4d6a-8533-dd3f6db34c5e tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.198s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:29:00 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:05 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:29:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:29:07 user nova-compute[76161]: INFO nova.compute.manager [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Detaching volume 25a08da0-5af3-4876-9f23-82012aec5f9c
Nov 14 18:29:07 user nova-compute[76161]: INFO nova.virt.block_device [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attempting to driver detach volume 25a08da0-5af3-4876-9f23-82012aec5f9c from mountpoint /dev/vdb
Nov 14 18:29:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Attempting to detach device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:29:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:29:07 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:29:07 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:29:07 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:29:07 user nova-compute[76161]:   <serial>25a08da0-5af3-4876-9f23-82012aec5f9c</serial>
Nov 14 18:29:07 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:29:07 user nova-compute[76161]: </disk>
Nov 14 18:29:07 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:29:08 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Successfully detached device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the persistent domain config.
Nov 14 18:29:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:29:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:29:08 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:29:08 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:29:08 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:29:08 user nova-compute[76161]:   <serial>25a08da0-5af3-4876-9f23-82012aec5f9c</serial>
Nov 14 18:29:08 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:29:08 user nova-compute[76161]: </disk>
Nov 14 18:29:08 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:29:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:29:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:29:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:29:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:29:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:29:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:26 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:28 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 924c630f-5712-4eed-a9fb-ec6850979887 is timed out.
Nov 14 18:29:28 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Successfully detached device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the live domain config.
Nov 14 18:29:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCOAdztg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:29:28 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f1a978-108a-43f5-8146-e4e648cda1b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:29:28 user nova-compute[76161]: No targets found.
Nov 14 18:29:28 user nova-compute[76161]: iSNS:
Nov 14 18:29:28 user nova-compute[76161]: No targets found.
Nov 14 18:29:28 user nova-compute[76161]: STATIC:
Nov 14 18:29:28 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c
Nov 14 18:29:28 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:29:28 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:29:28 user nova-compute[76161]: FIRMWARE:
Nov 14 18:29:28 user nova-compute[76161]: No targets found.
Nov 14 18:29:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:29:28 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:29:28 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[436e9cbc-8154-4287-899f-60b8e5f03891]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c3599f-aa0d-4d6a-a311-b67104f96204]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c (non-flash)
Nov 14 18:29:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c (non-flash)
Nov 14 18:29:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f06e00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f847f69-d291-4455-8345-e0c76da1ed42]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f196df8-41ad-43fa-848a-bf45216750b2]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c2fd82-085e-4e25-aaaf-535884f0c905]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce547ea4-be06-4e20-a625-bab8fe4930f5]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d81dd0b-a55c-45f4-af3b-ce7decbb9c3e]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5677d8-3cd4-4967-b3d8-f07cbf9f475f]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c, portal: 172.16.0.220,3260]
Nov 14 18:29:28 user nova-compute[76161]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c, portal: 172.16.0.220,3260] successful.
Nov 14 18:29:28 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a08da0-5af3-4876-9f23-82012aec5f9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdb127e-8468-421d-a66a-708aec2e44f1]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== disconnect_volume: return (264ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:29:28 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:29:29 user nova-compute[76161]: DEBUG nova.objects.instance [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:29:29 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-b601b491-05fe-440a-b0a2-af1dcc93fea6 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.637s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:29:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:42 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:29:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:29:43 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:29:43 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:29:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:29:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:29:43 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:29:43 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:29:43 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating instance_info_cache with network_info: [{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:29:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:29:43 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:29:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:29:46 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:29:46 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:29:49 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:29:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:29:50 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:29:50 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:29:50 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=25.045703887939453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:29:50 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:29:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 924c630f-5712-4eed-a9fb-ec6850979887 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:29:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:29:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:29:51 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:29:51 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:29:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:29:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:29:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:29:55 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:29:55 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:29:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:29:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:29:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:29:59 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:29:59 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:30:00 user nova-compute[76161]: INFO nova.compute.manager [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attaching volume 2a9df1c7-d286-4cde-833a-597540e680d7 to /dev/vdb
Nov 14 18:30:00 user nova-compute[76161]: DEBUG os_brick.utils [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda9370-37d6-4699-a946-f47f8b027feb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e285362e-bd8a-415d-a433-87564548cc66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[33885a4e-11e8-4056-b4c3-06b34f393e31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb635dd-af55-4070-a83e-dc53f63c8869]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:30:00 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:30:00 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e9187d-6a17-4aae-bf58-7ab90397158a]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG os_brick.utils [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:30:00 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating existing volume attachment record: 662be6b8-2a94-4384-a2d3-20874f9064c9 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:30:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXTjVwbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:30:04 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:30:04 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:30:04 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9986579d-2bcd-4fe4-a08c-00da72960e07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:30:04 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[352ffe98-a236-478b-8673-7bf66b850703]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7] added
Nov 14 18:30:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[55278f3c-72cc-43a0-99df-1c4602a295c0]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[270d7eef-30bc-4928-bf73-13cb9244af1d]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXTjVwbs {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXTjVwbs" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada6f22d-45cf-4ceb-a625-dedcb45292f8]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MXTjVwbs'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98f1d70-f861-4f1d-b42e-b0bcb2a5b0e3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d348da8-3549-4c27-b0ed-3a1865b0043b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 18:30:04 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 18:30:04 user nova-compute[76161]:  {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:30:04 user nova-compute[76161]: WARNING os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 18:30:04 user nova-compute[76161]: 
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[080aa2ef-5824-4e91-90df-0c4a32cbcdfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7, portal: 172.16.0.220,3260]
Nov 14 18:30:04 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7, portal: 172.16.0.220,3260] successful.
Nov 14 18:30:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ff9f61-e8a5-427c-af82-6627dddfb13f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f23c3a-d3d3-4652-8ce5-9e5036f56b18]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 (non-flash)
Nov 14 18:30:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 (non-flash)
Nov 14 18:30:04 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81069e1-131c-49a9-87e3-0e955ea650b6]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:30:04 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXTjVwbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:30:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:30:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23665303464633231', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:30:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665303464633231', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:30:05 user nova-compute[76161]: DEBUG nova.objects.instance [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:30:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:30:05 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:30:05 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:30:05 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:30:05 user nova-compute[76161]:   <serial>2a9df1c7-d286-4cde-833a-597540e680d7</serial>
Nov 14 18:30:05 user nova-compute[76161]: </disk>
Nov 14 18:30:05 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:30:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:30:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:30:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No VIF found with MAC fa:16:3e:f9:14:16, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:30:06 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-8ef93d7a-b92a-46f5-af90-815bb64264b7 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.561s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:30:09 user nova-compute[76161]: INFO nova.compute.manager [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Detaching volume 2a9df1c7-d286-4cde-833a-597540e680d7
Nov 14 18:30:09 user nova-compute[76161]: INFO nova.virt.block_device [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attempting to driver detach volume 2a9df1c7-d286-4cde-833a-597540e680d7 from mountpoint /dev/vdb
Nov 14 18:30:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Attempting to detach device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:30:09 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:30:09 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:30:09 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:30:09 user nova-compute[76161]:   <serial>2a9df1c7-d286-4cde-833a-597540e680d7</serial>
Nov 14 18:30:09 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:30:09 user nova-compute[76161]: </disk>
Nov 14 18:30:09 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:30:09 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Successfully detached device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the persistent domain config.
Nov 14 18:30:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:30:09 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:30:09 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:30:09 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:30:09 user nova-compute[76161]:   <serial>2a9df1c7-d286-4cde-833a-597540e680d7</serial>
Nov 14 18:30:09 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:30:09 user nova-compute[76161]: </disk>
Nov 14 18:30:09 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:30:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:30:29 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 924c630f-5712-4eed-a9fb-ec6850979887 is timed out.
Nov 14 18:30:29 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Successfully detached device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the live domain config.
Nov 14 18:30:29 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXTjVwbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:30:29 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3243c2-506a-451f-8079-63e40719022e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:30:29 user nova-compute[76161]: No targets found.
Nov 14 18:30:29 user nova-compute[76161]: iSNS:
Nov 14 18:30:29 user nova-compute[76161]: No targets found.
Nov 14 18:30:29 user nova-compute[76161]: STATIC:
Nov 14 18:30:29 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7
Nov 14 18:30:29 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:30:29 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:30:29 user nova-compute[76161]: FIRMWARE:
Nov 14 18:30:29 user nova-compute[76161]: No targets found.
Nov 14 18:30:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:30:29 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:30:29 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c442a64-6ec6-464f-8fac-48428b1664cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44882a2-bb4c-4da8-88f8-de95c2be60a1]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 (non-flash)
Nov 14 18:30:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 (non-flash)
Nov 14 18:30:29 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0128a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[972dc3a3-e9a9-4462-96ee-fe9f4a5a2453]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[323143dc-106d-4507-a1d0-69c8d27ba517]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4edfe34-f5b5-45f8-9897-c5977c66e296]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b0c4b7-76ab-4de4-b225-2b6324401ebd]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1a4ae9-05b0-4c48-a937-e2f65d435a51]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:29 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66b9e73-199c-4973-b311-728ece37491d]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7, portal: 172.16.0.220,3260]
Nov 14 18:30:30 user nova-compute[76161]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7, portal: 172.16.0.220,3260] successful.
Nov 14 18:30:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a9df1c7-d286-4cde-833a-597540e680d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd39426-4b52-4ebb-869e-db5a995bc459]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== disconnect_volume: return (258ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG nova.objects.instance [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:30:30 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-acfb62cc-4236-4c8e-b96c-3b2ff8d9a562 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.495s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:30:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating instance_info_cache with network_info: [{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:30:43 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:30:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:47 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:30:47 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:30:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:30:50 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:30:51 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:30:51 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:30:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.044795989990234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:30:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 924c630f-5712-4eed-a9fb-ec6850979887 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing inventories for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating ProviderTree inventory for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Updating inventory in ProviderTree for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing aggregate associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, aggregates: None {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Refreshing trait associations for resource provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI {{(pid=76161) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:30:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:30:53 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:30:53 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:30:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:30:57 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:30:59 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:30:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:00 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 18:31:00 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] There are 0 instances to clean {{(pid=76161) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:31:01 user nova-compute[76161]: INFO nova.compute.manager [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attaching volume 59ce822d-498c-43c6-b4af-5124121417c0 to /dev/vdb
Nov 14 18:31:01 user nova-compute[76161]: DEBUG os_brick.utils [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f78e860-98a6-42aa-ac74-34f33bcc0bd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8547b1c4-3e17-4efe-bf93-af84d7399508]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a85635-0774-4829-81fb-91e577762d66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[50066b3c-8b52-4f3a-a831-0f9ef48611e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:31:01 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:31:01 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b159c8-dbd5-436e-a27d-d16fef37fa93]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG os_brick.utils [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:31:01 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating existing volume attachment record: 95393c6d-9b7a-49ae-8f67-a553cd4939d1 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:31:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYlrxCmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:31:05 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:31:05 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:31:05 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3101d9db-e5da-42d0-9bc5-3f0829850ce8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:31:05 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[de465835-2d29-445a-9bfc-f85c5a7788d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0] added
Nov 14 18:31:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a200f6-fd08-4164-a47e-7ebbca58d3a6]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b96c8b3-9f66-44f2-ac33-bbdbd8d4e3a0]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYlrxCmI {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYlrxCmI" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf888fc4-a899-4044-b9de-22c093899ec3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KYlrxCmI'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e63033-e5cf-47a2-ab20-02f0e8398e09]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9c716c-d968-4f16-a837-dc6e12bce85b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 18:31:05 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 18:31:05 user nova-compute[76161]:  {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:31:05 user nova-compute[76161]: WARNING os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 18:31:05 user nova-compute[76161]: 
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb0986a-2d1b-4a25-9a53-2372f233651a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0, portal: 172.16.0.220,3260]
Nov 14 18:31:05 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0, portal: 172.16.0.220,3260] successful.
Nov 14 18:31:05 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:05 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ff4900-1245-4bcb-b9bb-b4bc5f8f9632]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ec5850-048f-4d85-8efb-2497af9a7be3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 (non-flash)
Nov 14 18:31:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 (non-flash)
Nov 14 18:31:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31aa274-4c47-4577-a23f-86423e053bff]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYlrxCmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23563333139343065', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563333139343065', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:31:07 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:31:07 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:31:07 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:31:07 user nova-compute[76161]:   <serial>59ce822d-498c-43c6-b4af-5124121417c0</serial>
Nov 14 18:31:07 user nova-compute[76161]: </disk>
Nov 14 18:31:07 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No VIF found with MAC fa:16:3e:f9:14:16, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:31:07 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-d6683f31-ab24-45b5-9054-cef2dfa53053 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.309s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:31:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:31:09 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:31:09 user nova-compute[76161]: INFO nova.compute.manager [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Detaching volume 59ce822d-498c-43c6-b4af-5124121417c0
Nov 14 18:31:09 user nova-compute[76161]: INFO nova.virt.block_device [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attempting to driver detach volume 59ce822d-498c-43c6-b4af-5124121417c0 from mountpoint /dev/vdb
Nov 14 18:31:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Attempting to detach device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:31:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:31:09 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:31:09 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:31:09 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:31:09 user nova-compute[76161]:   <serial>59ce822d-498c-43c6-b4af-5124121417c0</serial>
Nov 14 18:31:09 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:31:09 user nova-compute[76161]: </disk>
Nov 14 18:31:09 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:31:09 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Successfully detached device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the persistent domain config.
Nov 14 18:31:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:31:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:31:09 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:31:09 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:31:09 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:31:09 user nova-compute[76161]:   <serial>59ce822d-498c-43c6-b4af-5124121417c0</serial>
Nov 14 18:31:09 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:31:09 user nova-compute[76161]: </disk>
Nov 14 18:31:09 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:31:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:09 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:31:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:15 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:15 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Cleaning up deleted instances with incomplete migration  {{(pid=76161) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 18:31:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:31:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:29 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 924c630f-5712-4eed-a9fb-ec6850979887 is timed out.
Nov 14 18:31:29 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Successfully detached device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the live domain config.
Nov 14 18:31:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYlrxCmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:31:30 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[85838cc8-b59a-4d47-89b6-811cd3e937f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:31:30 user nova-compute[76161]: No targets found.
Nov 14 18:31:30 user nova-compute[76161]: iSNS:
Nov 14 18:31:30 user nova-compute[76161]: No targets found.
Nov 14 18:31:30 user nova-compute[76161]: STATIC:
Nov 14 18:31:30 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0
Nov 14 18:31:30 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:31:30 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:31:30 user nova-compute[76161]: FIRMWARE:
Nov 14 18:31:30 user nova-compute[76161]: No targets found.
Nov 14 18:31:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:31:30 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:31:30 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef25916-3a30-4acd-a16e-f6fc4f55011e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1726ba-0389-420a-a65f-0f07a0d01816]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 (non-flash)
Nov 14 18:31:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 (non-flash)
Nov 14 18:31:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f8422dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7f396d-d4d0-4f69-a6b3-4ed16d625d8d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddd4b8d-bb89-4e47-9f89-10238b2f40b0]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a2a807-9f71-4f3a-b451-dcad0c61a355]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[586361e1-47bd-4638-add1-bef148dabeea]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bea31e-b17f-4013-ac5a-b7c5197b6c8f]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef9e170-971a-4aa6-b445-948f99ccfa25]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0, portal: 172.16.0.220,3260]
Nov 14 18:31:30 user nova-compute[76161]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0, portal: 172.16.0.220,3260] successful.
Nov 14 18:31:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ce822d-498c-43c6-b4af-5124121417c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f05eb5e-2f2f-407e-9c92-c8e546c67f88]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== disconnect_volume: return (289ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:31:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:31:31 user nova-compute[76161]: DEBUG nova.objects.instance [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:31:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-3b2912c4-0c3a-456b-b097-17345786be01 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.614s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:31:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:31:44 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:45 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:31:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:31:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:31:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:31:45 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:31:45 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:31:45 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating instance_info_cache with network_info: [{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:31:45 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:31:45 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:31:49 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:49 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:31:51 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:31:51 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:31:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=25.043811798095703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:31:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:31:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 924c630f-5712-4eed-a9fb-ec6850979887 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:31:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:31:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:31:52 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:31:52 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:31:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:31:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:31:53 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:53 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:53 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:53 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:31:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:31:59 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:59 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:31:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:32:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:32:01 user nova-compute[76161]: DEBUG nova.objects.instance [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:32:01 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:32:02 user nova-compute[76161]: INFO nova.compute.manager [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attaching volume a30293c4-ed2b-4973-b604-a0457e75b86d to /dev/vdb
Nov 14 18:32:02 user nova-compute[76161]: DEBUG os_brick.utils [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72009a0-0453-4dd9-88ff-704f30ce93bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6cf222172fb\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5907ba-e1f6-4230-9430-0f8046bc81d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[7036a37a-2a16-4695-98e9-11d4fe6ace0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb3a558-b9c3-40b5-8cf7-0f96c25b4114]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Running cmd (subprocess): nvme version {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] 'nvme version' failed. Not Retrying. {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] nvme not present on system {{(pid=76161) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 18:32:02 user nova-compute[76161]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 18:32:02 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e227555-0b52-47b4-8c73-81b60eb67eb1]: (4, '') {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76161) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.lightos [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] LIGHTOS: no hostnqn found. {{(pid=76161) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG os_brick.utils [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6cf222172fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:32:02 user nova-compute[76161]: DEBUG nova.virt.block_device [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating existing volume attachment record: 4c2f5c6b-451d-47c9-a2a2-87cd3d717839 {{(pid=76161) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 18:32:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Calling os-brick to attach iSCSI Volume {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BWbzexEf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:32:06 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:32:06 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:32:06 user nova-compute[76161]: INFO os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7dc906-d3e2-4e55-aed6-5b5a52d48057]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 18:32:06 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --interface default --op new {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[279a15c0-0366-4813-ba8f-0d4152810e6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d] added\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d] added
Nov 14 18:32:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2851a61b-63ec-425b-a5e2-e344bcea03dd]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1872d7-a605-47a3-a120-b134ec58f5c4]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BWbzexEf {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BWbzexEf" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f89995-0632-4469-8b6d-224dfb3d432b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BWbzexEf'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cdde18-34e7-4b98-b0db-e6862e536fa3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8c218e-acc1-4e03-8a99-37ba0ec12247]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 18:32:06 user nova-compute[76161]:  {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 18:32:06 user nova-compute[76161]:  {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:32:06 user nova-compute[76161]: WARNING os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 18:32:06 user nova-compute[76161]: 
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --login {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ce8505-fbd9-4b6c-adba-c01ae6c520ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d, portal: 172.16.0.220,3260]
Nov 14 18:32:06 user nova-compute[76161]: Login to [iface: default, target: iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d, portal: 172.16.0.220,3260] successful.
Nov 14 18:32:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d3a3af-8988-401d-8b0b-3a3d37297afc]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[a264f852-5894-4f4b-9843-adde60e57306]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d (non-flash)
Nov 14 18:32:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d (non-flash)
Nov 14 18:32:06 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Connected to 172.16.0.220:3260 {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=76161) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76161) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a46414-b243-454a-8611-2e0d0df922ed]: (4, ('- - 0', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76161) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 18:32:06 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BWbzexEf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76161) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 18:32:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:32:07 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23061623539333634', 'path': '/dev/sdb'} {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:32:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061623539333634', 'path': '/dev/sdb'} {{(pid=76161) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 18:32:07 user nova-compute[76161]: DEBUG nova.objects.instance [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:32:07 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 18:32:07 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:32:07 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:32:07 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:32:07 user nova-compute[76161]:   <serial>a30293c4-ed2b-4973-b604-a0457e75b86d</serial>
Nov 14 18:32:07 user nova-compute[76161]: </disk>
Nov 14 18:32:07 user nova-compute[76161]:  {{(pid=76161) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 18:32:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No BDM found with device name vda, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:32:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76161) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 18:32:08 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] No VIF found with MAC fa:16:3e:f9:14:16, not building metadata {{(pid=76161) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 18:32:08 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-62f6e8f7-e784-47ae-8238-e360e05063a9 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.206s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:32:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:32:10 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:32:10 user nova-compute[76161]: INFO nova.compute.manager [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Detaching volume a30293c4-ed2b-4973-b604-a0457e75b86d
Nov 14 18:32:10 user nova-compute[76161]: INFO nova.virt.block_device [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Attempting to driver detach volume a30293c4-ed2b-4973-b604-a0457e75b86d from mountpoint /dev/vdb
Nov 14 18:32:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Attempting to detach device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the persistent domain config. {{(pid=76161) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 18:32:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:32:10 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:32:10 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:32:10 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:32:10 user nova-compute[76161]:   <serial>a30293c4-ed2b-4973-b604-a0457e75b86d</serial>
Nov 14 18:32:10 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:32:10 user nova-compute[76161]: </disk>
Nov 14 18:32:10 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:32:10 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Successfully detached device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the persistent domain config.
Nov 14 18:32:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the live domain config. {{(pid=76161) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 18:32:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.guest [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 18:32:10 user nova-compute[76161]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 18:32:10 user nova-compute[76161]:   <source dev="/dev/sdb"/>
Nov 14 18:32:10 user nova-compute[76161]:   <target dev="vdb" bus="virtio"/>
Nov 14 18:32:10 user nova-compute[76161]:   <serial>a30293c4-ed2b-4973-b604-a0457e75b86d</serial>
Nov 14 18:32:10 user nova-compute[76161]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 18:32:10 user nova-compute[76161]: </disk>
Nov 14 18:32:10 user nova-compute[76161]:  {{(pid=76161) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 18:32:10 user nova-compute[76161]: DEBUG nova.virt.libvirt.driver [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 18:32:11 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:30 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 924c630f-5712-4eed-a9fb-ec6850979887 is timed out.
Nov 14 18:32:30 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Successfully detached device vdb from instance 924c630f-5712-4eed-a9fb-ec6850979887 from the live domain config.
Nov 14 18:32:30 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] calling os-brick to detach iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb4f80d9300>, {'target_iqn': 'iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BWbzexEf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 18:32:30 user nova-compute[76161]: WARNING os_brick.initiator.connectors.base [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 18:32:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8fde2d-0ce2-4738-972e-33a3ed341cfc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 18:32:30 user nova-compute[76161]: No targets found.
Nov 14 18:32:30 user nova-compute[76161]: iSNS:
Nov 14 18:32:30 user nova-compute[76161]: No targets found.
Nov 14 18:32:30 user nova-compute[76161]: STATIC:
Nov 14 18:32:30 user nova-compute[76161]: Target: iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d
Nov 14 18:32:30 user nova-compute[76161]:         Portal: 172.16.0.220:3260,-1
Nov 14 18:32:30 user nova-compute[76161]:                 Iface Name: default
Nov 14 18:32:30 user nova-compute[76161]: FIRMWARE:
Nov 14 18:32:30 user nova-compute[76161]: No targets found.
Nov 14 18:32:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 18:32:30 user nova-compute[76161]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 18:32:30 user nova-compute[76161]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76161) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d', 0)] {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7f6c6b-409a-4c1a-ad9d-7bf2db2aa991]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[5406733f-1926-4cc5-98d9-0f8d13997d41]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d (non-flash)\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d (non-flash)
Nov 14 18:32:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d (non-flash)
Nov 14 18:32:30 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb4f0139a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d'): ({'sdb'}, set())}) {{(pid=76161) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Removing single pathed devices sdb {{(pid=76161) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbb3800-d2d3-4da8-8f8d-196ed2a552f7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:30 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe5609-ea67-43f0-adb6-3ae4d81bfc2c]: (4, ('ok\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Flushing IO for device /dev/sdb {{(pid=76161) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[16658b94-7311-4b9c-a6d1-effee9b7042b]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76161) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3300140b-8c1c-403d-a273-baa5e180b56e]: (4, ('1', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG os_brick.initiator.linuxscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] SCSI volumes sdb have been removed. {{(pid=76161) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d')] {{(pid=76161) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0114e97-d551-4cee-b7f5-930f1c9f60c3]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --logout {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[415f33e9-5281-4628-9de2-2b53fddedc44]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d, portal: 172.16.0.220,3260]
Nov 14 18:32:31 user nova-compute[76161]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d, portal: 172.16.0.220,3260] successful.
Nov 14 18:32:31 user nova-compute[76161]:  stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op delete {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30293c4-ed2b-4973-b604-a0457e75b86d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86560) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo.privsep.daemon [-] privsep: reply[3176a3be-8209-4cb9-bbea-ca9c0e68d454]: (4, ('', '')) {{(pid=86560) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76161) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.base [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] <== disconnect_volume: return (305ms) None {{(pid=76161) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Disconnected iSCSI Volume {{(pid=76161) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG nova.objects.instance [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'flavor' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:32:31 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-4cbe9b6b-cef1-45fc-9ea7-751a22ae64cf tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.616s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:32:34 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:39 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:44 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:46 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:32:47 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:32:47 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:32:47 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:32:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 18:32:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquired lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 18:32:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Forcefully refreshing network info cache for instance {{(pid=76161) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 18:32:47 user nova-compute[76161]: DEBUG nova.objects.instance [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lazy-loading 'info_cache' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:32:47 user nova-compute[76161]: DEBUG nova.network.neutron [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating instance_info_cache with network_info: [{"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:32:47 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Releasing lock "refresh_cache-924c630f-5712-4eed-a9fb-ec6850979887" {{(pid=76161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 18:32:47 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updated the network info_cache for instance {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 18:32:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:50 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_concurrency.processutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76161) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 18:32:51 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:32:51 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:32:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=25.04288101196289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:32:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:32:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Instance 924c630f-5712-4eed-a9fb-ec6850979887 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76161) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 18:32:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:32:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:32:52 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:32:52 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:32:52 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:32:52 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:32:53 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:32:54 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:32:54 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:32:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:32:55 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:32:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:00 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:33:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:33:13 user nova-compute[76161]: INFO nova.compute.manager [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Terminating instance
Nov 14 18:33:13 user nova-compute[76161]: DEBUG nova.compute.manager [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Start destroying the instance on the hypervisor. {{(pid=76161) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-9a243ad0-e6b9-4e16-a9e2-33f1d6820c6e req-ad4f0091-e480-43e2-aa74-786f6e7c8ffa service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received event network-vif-unplugged-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9a243ad0-e6b9-4e16-a9e2-33f1d6820c6e req-ad4f0091-e480-43e2-aa74-786f6e7c8ffa service nova] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9a243ad0-e6b9-4e16-a9e2-33f1d6820c6e req-ad4f0091-e480-43e2-aa74-786f6e7c8ffa service nova] Lock "924c630f-5712-4eed-a9fb-ec6850979887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-9a243ad0-e6b9-4e16-a9e2-33f1d6820c6e req-ad4f0091-e480-43e2-aa74-786f6e7c8ffa service nova] Lock "924c630f-5712-4eed-a9fb-ec6850979887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-9a243ad0-e6b9-4e16-a9e2-33f1d6820c6e req-ad4f0091-e480-43e2-aa74-786f6e7c8ffa service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] No waiting events found dispatching network-vif-unplugged-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG nova.compute.manager [req-9a243ad0-e6b9-4e16-a9e2-33f1d6820c6e req-ad4f0091-e480-43e2-aa74-786f6e7c8ffa service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received event network-vif-unplugged-babe43bc-e2f2-44b9-a39d-1d5127371584 for instance with task_state deleting. {{(pid=76161) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [-] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Instance destroyed successfully.
Nov 14 18:33:13 user nova-compute[76161]: DEBUG nova.objects.instance [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lazy-loading 'resources' on Instance uuid 924c630f-5712-4eed-a9fb-ec6850979887 {{(pid=76161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG nova.virt.libvirt.vif [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T18:26:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-964003529',display_name='tempest-SnapshotDataIntegrityTests-server-964003529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-964003529',id=53,image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCs3iUswbooz7iCb2hdnlRW8JehcuOjhTWHBoJnbZaCjw+B8k4y6DZThdK3ji8taWeGLiC9iIwt/P4Jac8tajBENvoT3VQtWxq1AQbjKdBJcR6WRT29a6N5XTG0/sRnLQ==',key_name='tempest-keypair-1396118114',keypairs=<?>,launch_index=0,launched_at=2023-11-14T18:27:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa1ba630cb0d4725af03a93945f39596',ramdisk_id='',reservation_id='r-o7yucncr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1804ef46-1f05-4c8f-910b-8e52c7b69935',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-703268280',owner_user_name='tempest-SnapshotDataIntegrityTests-703268280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T18:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29dc4b1bef4d4b27928ec73402fcbd7e',uuid=924c630f-5712-4eed-a9fb-ec6850979887,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Converting VIF {"id": "babe43bc-e2f2-44b9-a39d-1d5127371584", "address": "fa:16:3e:f9:14:16", "network": {"id": "f323a08f-29bc-4415-ad2c-d85e64e7770c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-991705756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa1ba630cb0d4725af03a93945f39596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbabe43bc-e2", "ovs_interfaceid": "babe43bc-e2f2-44b9-a39d-1d5127371584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG nova.network.os_vif_util [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:14:16,bridge_name='br-int',has_traffic_filtering=True,id=babe43bc-e2f2-44b9-a39d-1d5127371584,network=Network(f323a08f-29bc-4415-ad2c-d85e64e7770c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabe43bc-e2') {{(pid=76161) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG os_vif [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:14:16,bridge_name='br-int',has_traffic_filtering=True,id=babe43bc-e2f2-44b9-a39d-1d5127371584,network=Network(f323a08f-29bc-4415-ad2c-d85e64e7770c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabe43bc-e2') {{(pid=76161) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbabe43bc-e2, bridge=br-int, if_exists=True) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea00c7fe-4e66-465b-934f-7e8fdd19daf1) {{(pid=76161) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:13 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:33:13 user nova-compute[76161]: INFO os_vif [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:14:16,bridge_name='br-int',has_traffic_filtering=True,id=babe43bc-e2f2-44b9-a39d-1d5127371584,network=Network(f323a08f-29bc-4415-ad2c-d85e64e7770c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbabe43bc-e2')
Nov 14 18:33:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Deleting instance files /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887_del
Nov 14 18:33:13 user nova-compute[76161]: INFO nova.virt.libvirt.driver [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Deletion of /opt/stack/data/nova/instances/924c630f-5712-4eed-a9fb-ec6850979887_del complete
Nov 14 18:33:14 user nova-compute[76161]: INFO nova.compute.manager [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 18:33:14 user nova-compute[76161]: DEBUG oslo.service.loopingcall [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76161) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 18:33:14 user nova-compute[76161]: DEBUG nova.compute.manager [-] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Deallocating network for instance {{(pid=76161) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 18:33:14 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] deallocate_for_instance() {{(pid=76161) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 18:33:14 user nova-compute[76161]: DEBUG nova.network.neutron [-] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Updating instance_info_cache with network_info: [] {{(pid=76161) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 18:33:14 user nova-compute[76161]: INFO nova.compute.manager [-] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Took 0.73 seconds to deallocate network for instance.
Nov 14 18:33:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:33:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:33:14 user nova-compute[76161]: DEBUG nova.compute.manager [req-dacf7490-14d6-4710-9a64-65b4e86cbec5 req-8a2e50ac-26d1-4d74-82ff-1e62602dfa85 service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received event network-vif-deleted-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:33:14 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:33:14 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:33:14 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:33:15 user nova-compute[76161]: INFO nova.scheduler.client.report [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Deleted allocations for instance 924c630f-5712-4eed-a9fb-ec6850979887
Nov 14 18:33:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-7219980b-6c31-4654-9963-15418fbd6459 tempest-SnapshotDataIntegrityTests-703268280 tempest-SnapshotDataIntegrityTests-703268280-project-member] Lock "924c630f-5712-4eed-a9fb-ec6850979887" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.919s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:33:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-cd42d04b-1d16-429c-8fad-7741388f1b0f req-342b56bf-b9df-4b8c-a2d2-a273e639a9ba service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received event network-vif-plugged-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 18:33:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cd42d04b-1d16-429c-8fad-7741388f1b0f req-342b56bf-b9df-4b8c-a2d2-a273e639a9ba service nova] Acquiring lock "924c630f-5712-4eed-a9fb-ec6850979887-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:33:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cd42d04b-1d16-429c-8fad-7741388f1b0f req-342b56bf-b9df-4b8c-a2d2-a273e639a9ba service nova] Lock "924c630f-5712-4eed-a9fb-ec6850979887-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:33:15 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [req-cd42d04b-1d16-429c-8fad-7741388f1b0f req-342b56bf-b9df-4b8c-a2d2-a273e639a9ba service nova] Lock "924c630f-5712-4eed-a9fb-ec6850979887-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:33:15 user nova-compute[76161]: DEBUG nova.compute.manager [req-cd42d04b-1d16-429c-8fad-7741388f1b0f req-342b56bf-b9df-4b8c-a2d2-a273e639a9ba service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] No waiting events found dispatching network-vif-plugged-babe43bc-e2f2-44b9-a39d-1d5127371584 {{(pid=76161) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 18:33:15 user nova-compute[76161]: WARNING nova.compute.manager [req-cd42d04b-1d16-429c-8fad-7741388f1b0f req-342b56bf-b9df-4b8c-a2d2-a273e639a9ba service nova] [instance: 924c630f-5712-4eed-a9fb-ec6850979887] Received unexpected event network-vif-plugged-babe43bc-e2f2-44b9-a39d-1d5127371584 for instance with vm_state deleted and task_state None.
Nov 14 18:33:18 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:33:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:33:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:33:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:33:23 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:28 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:33 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:33:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:33:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:33:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:33:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:33:38 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:43 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:47 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:33:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:33:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76161) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 18:33:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:33:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76161) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 18:33:49 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:49 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:33:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Starting heal instance info cache {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 18:33:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Rebuilding the list of instances to heal {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 18:33:49 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Didn't find any instances for network info cache update. {{(pid=76161) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager.update_available_resource {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Auditing locally available compute resources for user (node: user) {{(pid=76161) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 18:33:51 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:33:51 user nova-compute[76161]: WARNING nova.virt.libvirt.driver [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 18:33:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Hypervisor/Node resource view: name=user free_ram=9116MB free_disk=25.070030212402344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76161) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76161) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG nova.compute.provider_tree [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed in ProviderTree for provider: eef4e2ad-d4c6-40c7-9f76-0a052858d5fd {{(pid=76161) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG nova.scheduler.client.report [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Inventory has not changed for provider eef4e2ad-d4c6-40c7-9f76-0a052858d5fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76161) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG nova.compute.resource_tracker [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Compute_service record updated for user:user {{(pid=76161) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 18:33:51 user nova-compute[76161]: DEBUG oslo_concurrency.lockutils [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=76161) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 18:33:53 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:33:54 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:33:56 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:33:56 user nova-compute[76161]: DEBUG nova.compute.manager [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76161) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 18:33:57 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:33:59 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 18:34:01 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:34:02 user nova-compute[76161]: DEBUG oslo_service.periodic_task [None req-5ba7d96d-430c-45cd-9352-efff660f3662 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76161) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 18:34:03 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:34:04 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:34:07 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:34:09 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:34:10 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:34:14 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:34:19 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:34:24 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 18:34:29 user nova-compute[76161]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=76161) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}